Skip to main content

Posts

Deepseek's Architecture Adaptation of Export Controls

Deep Seek's GPU Infrastructure Initially acquired 10,000 GPUs in 2021 Estimated to have grown to around 50,000 GPUs in total Used 2,000 H800 GPUs specifically for V3 model pre-training Share infrastructure with their quantitative trading fund operations Initial Export Control Framework US government initially restricted two parameters : Computing power (FLOPS) Interconnect bandwidth between GPUs This two-factor restriction created an opportunity for optimisation H800 GPU Restrictions and Adaptations H800 was China's version of the H100 GPU Two key restriction factors from the US government: Chip compute (FLOPS) Interconnect bandwidth H800 was designed with: Full FLOPS capability (same as H100) Restricted interconnect bandwidth Deep Seek developed specialized SM (Streaming Multiprocessor) scheduling techniques to work around interconnect limitations Managed to achieve full GPU utilisation despite interconnect restrictions Export Control Evolution First Phase: Dual restric...

Three Software Powerhouses of AI - Snowflake, Palantir, and Databricks

 Let's break down how Snowflake, Palantir, and Databricks work together in the AI world, using a technology stack analogy and real-world examples. The AI Technology Stack Think of building an AI-powered company like building a house. You need a solid foundation, a smart design, and skilled builders. Foundation (Data): Snowflake Layman's Terms: Snowflake is like the concrete foundation of your AI house. It stores all your data in one organized place, making it easy to access and use. It's not just storage; it's like a super-organized library where any information can be found instantly.   Technical Function: Snowflake is a cloud-based data warehouse. It allows companies to store vast amounts of structured and semi-structured data, making it readily available for analysis and AI model training. It handles the messy work of data organization and access.   Example: Imagine a retail company. Snowflake stores all their sales data, customer information, inven...

The Future of Enterprise AI: Palantir's AIP

  The Future of Enterprise AI: Palantir's AIP Palantir's AI Platform (AIP) is revolutionising how enterprises harness data's power. By integrating, analysing, and visualising vast datasets, AIP enables organisations to uncover valuable insights and make informed decisions. What Does Palantir AIP Offer? At its core, Palantir AIP is an ontology-driven platform. This means it uses a structured knowledge graph to represent concepts, entities, and their relationships. This foundational layer allows AIP to: Integrate diverse data sources: Seamlessly combine data from various sources, including structured and unstructured data. Visualise complex relationships: Use powerful visualisation tools to explore connections and patterns within data. Support decision-making: Provide actionable insights to drive strategic decisions and optimise operations. Opportunities for Service Providers For service providers, Palantir AIP presents a wealth of opportunities: Skill Development: Invest in ...

Telecom Network Evolution to Cloud Native

Telecom Network Evolution to Cloud Native    Emerging Trends in Telecom Network --

Cloud-Native in 2025: A Comprehensive Overview of Trends, Opportunities, and Challenges

  Cloud-Native in 2025: A Comprehensive Overview of Trends, Opportunities, and Challenges Introduction As we approach 2025, cloud-native architecture has evolved from a cutting-edge approach to a mainstream strategy for enterprise digital transformation. This blog post explores the key trends, strategic importance, benefits, challenges, and future trajectory of cloud-native technologies. Key Trends Shaping Cloud-Native Ecosystem 1. Cost Optimization: FinOps Takes Center Stage Cloud-native architectures are becoming increasingly complex, making cost management crucial. The emergence of FinOps (Financial Operations) is transforming how organizations approach cloud spending. Key developments include: Tools like OpenCost providing granular visibility into Kubernetes spend Projects such as OpenTelemetry, Prometheus, and OpenSearch enabling precise resource consumption tracking Organizations focusing on reducing overall spend without compromising performance 2. Developer Produ...

From Four to Six Pillars: The Evolution of the Australian Telecom Industry

From Four to Six Pillars: The Evolution of the Australian Telecom Industry  The Rise of Aussie Broadband:  The Australian telecommunications landscape has witnessed a significant transformation in recent years, shifting from a traditional four-pillar model dominated by Telstra, Optus, TPG, and the NBN, to a six-pillar model that now includes Vocus and Aussie Broadband. This evolution has been driven by a confluence of factors, including regulatory changes, evolving consumer demands, technological advancements, and strategic diversification. A "pillar" refers to any telecommunications operator with a revenue of $1Bn or more. A New Era of Competition Aussie Broadband, with its rapid growth and strategic acquisitions, has emerged as a key player in this evolving market. With revenue at ~$1Bn, the company is poised to solidify its position as the sixth pillar of the Australian telecommunications industry. (PE TTM - 35.7, PB - 1.7)  Key Factors Driving the Transition...

Nvidia's Post-Earnings Boost is Ahead: A Breakdown

 Nvidia's Post-Earnings Boost: A Breakdown Nvidia's upcoming earnings call on August 28th is highly anticipated due to several key factors that position the company for a potential share price surge. Key Factors Driving Nvidia's Potential Post-Earnings Boost Inventory Disparity: Nvidia's low inventory levels compared to AMD's bloated stock suggest strong demand and efficient production. This indicates a healthier financial position and potential for higher revenue. The contrast between the two chip giants highlights Nvidia's superior supply chain management and ability to capitalize on market demand. Dominant Pricing Power: Nvidia's H100 GPUs command a significantly higher price than AMD's competing MI300X, demonstrating exceptional pricing power. This pricing advantage translates into higher revenue per unit and improved profit margins, contributing to overall financial strength. LLM-Driven Demand Acceleration: The burgeoning LLM marke...