ChetanPatil Testing

Category: BLOG

  • The Race For AI Semiconductor Chips

    Photo by david latorre romero on Unsplash

    THE NEED FOR AI SEMICONDUCTOR CHIPS

    Multi-Core Processor (MCP) or Chip Multi-Processor (CMP) revolutionized the computing industry. MCP/CMP came up with advanced execution and parallelism techniques. Software took the opportunity provided by the multiple processors fused into the single System-On-A-Chip (SoC).

    MCP also provided the advantage of Out-of-Order Execution (OoOE), instructions-level parallelism (ILP), thread-level parallelism (TLP), and interleaved Simultaneous Multithreading (SMT), and allowed multiple applications to run on the same processor or multiple cores in the same SoC. Soon, the Single Instruction Stream, Single Data Stream (SISD) evolved into Multiple Instruction Streams, Multiple Data Streams (MIMD). MIMD gave a new experience to the data-intensive applications in the post-internet era.

    The semiconductor and computing industry took advantage of MCP for over a decade by incorporating different core/processing units into a single SoC. Multi-Processor/Core System-On-A-Chip (MPSoC/MCSoC) became the heart of the new data and memory-intensive application. MPSoC/MCSoC starting to come up with dedicated processing blocks for data related to the graphic (GPU), digital (DSP), vector/vision (VPU), neural (NPU), and High-Bandwidth Memory (HBM).

    The Artificial Intelligence System-On-A-Chip (AISoC) Is The Need Of The Future AI-Driven Workloads And Applications

    The software computing industry is demanding data be processed faster than ever from semiconductor chips. Shrinking the transistor size further is not allowing the data and memory-intensive AI/ML/DL workloads to make the best of the MPSoC/MCSoC. Even though there are many opportunities to improve and innovate by proposing smarter data management techniques (cache, memory, and threading), MPSoC/MCSoC seems to have hit the memory wall, area wall, power wall, thermal wall, and performance wall. The data centers that should be shrinking in size and space due to the technology node advancement are instead becoming large by churning out massively distributed systems with a large number of MPSoC/MCSoC connected with large memory (NUMA). 

    The data-intensive, compute-intensive and memory-intensive artificial intelligence applications/workloads demand SoC that is:

    • Low Cost:
      • Affordable to manufacture
    • Efficient:
      • Improved performance-per-watt (PPW)
    • High Parallelism:
      • Massively parallel execution without stalling
    • Smart:
      • Ability to generate/store/predict models on the go that reside closer to the cores
    • Zero Bottlenecks:
      • Processes the data without memory/interconnect bottlenecks with or without a co-processor
    • Adaptive Software:
      • Ability to get programmed with minimal high-level programming effort and adapts on the go
    • High-Speed Memory:
      • Provides a large amount of high bandwidth memory across different memory levels/hierarchies
    • Technology Node:
      • Works efficiently irrespective of the advanced technology nodes used

    The above eight-point feature is what will pay the way for Artificial Intelligence System-On-A-Chip (AISoC). These AISoC will be critical for the next generation of advanced solutions that will find use in the growing autonomous world. AISoC can be used in all devices and not only in the data centers. AISoC can speed up the fast-changing automotive to the satellite industry.

    To cater to the growing demand for the semiconductor SoC chips for Artificial Intelligence) and to also balance the complexity, cost, and time to market, the semiconductor industry has already started to move away from general-purpose cores to specialized cores.

    While the semiconductor industry is not labeling these new SoC as AISoC, but the features offered are of the AISoC world. Not all the AISoC solution adhere strictly to the eight-point features discussed above, but the solutions offered by different semiconductor companies is a step in the right direction.

    Picture By Chetan Arvind Patil

    THE STATUS OF AI SEMICONDUCTOR CHIPS RACE

    Leadership in AI semiconductor chips is vital. Countries across the world are competing to bring the best homegrown solution to establish the lead. Governments are also funding the semiconductor chip business with the hope of leading the semiconductor race and mainly the AI solution one.

    Apart from governments, companies across the globe are also racing against each other. From software giants to hardware leaders, all companies are investing zillions of time and money to come up with AI semiconductor chips out in the market.

    The Artificial Intelligence System-On-A-Chip (AISoC) development is happening in two parallel worlds:

    • Established companies building in-house AI semiconductor chips
    • Startups providing a new architectural solution to drive AI semiconductor chips market

    Below is the snapshot of the world’s top established companies racing against time to bring AISoC not only for their consumption but also for the market:

    Alibaba: Alibaba competes directly with e-commerce giants and mainly Amazon. It provides web services similar to Amazon Web Services. To cater to enterprise needs, Alibaba last year launched Hanguang 800 is capable of processing 78,563 images per second. Alibaba introduced XuanTie 910 in 2019 provides 40% more performance than reference ISA RISC-V. These two AISoC are only a handful of examples. Alibaba’s DAMO Academy is continuously innovating and is going to launch much more surprising products in the AISoC domain.

    Alphabet/Google: Alphabet’s Google arm has always been into hardware research and development. Google’s Brain and Hardware and Architecture team has been continuously providing solutions to make AI algorithms faster and smarter. Several AI-related hardware solutions have come out of Google. Google Cloud’s TPU is already becoming a benchmark for the AI industry. There are already many solutions that promise to improve the time to train networks using large data sets. Google is also pushing the envelope by taking the help of AI to design AI chips. With Pixel’s line of products, there is more room to innovate. In the coming years, Google will showcase innovative AISoC solutions.

    Amazon: Amazon caters to more than 200 million visitors per month. Every visitor provides Amazon business and also the data on his/her shopping behavior. To process and make use of such unique data and to also provide enterprises the efficient web services, Amazon has been investing in AI-driven chips for a long time. Amazon’s Inferentia is the first step towards conquering the server market that is AISoC powered. The growing Alexa line of products pushed Amazon to in-house AISoC development and the results are already been seen in form of smarter voice-assisted devices.

    AMD: AMD is another established semiconductor company with AISoC products. With AMD Instinct and AMD EPYC line of products, AMD has been steadily growing its market share in AI-enabled devices. AMD is also making most of the semiconductor chiplets technology to bring more innovation at the silicon level. Its acquisition of Xilinx is only going to help bring more AISoC solutions to the market. AMD is not deep into the mobile space, but they can certainly take advantage of the growing gaming industry to compensate. AMD CDNA is also another breakthrough architecture design to speed up high-performance computing.

    Apple: With the launch of M1, Apple has shown the world its next target is going to be more in-house Macbook and iPhone/iPad processors. M1 has a NPU that allows faster predictive actions for its users. Apple is also planning to launch X-Reality products, which will require elegant AISoC, for which Apple has already started the work.

    ARM: ARM IP has been critical for the smartphone industry and has taken the lead in providing AI-powered chips for mobile and also the data centers. With TOP500 won by ARM-powered supercomputers, ARM is ready to come up with more AISoC solution. Smart homes, wearables, and smartphones will see a massive use of AI Chip that will be powered by ARM. With Apple going all-in for ARM processors, and it will also help ARM innovate on the AISoC front.

    Baidu: Baidu is a giant in China and competes worldwide with Google, Amazon, and Alibaba. Baidu showcased the Kunlun AI processor during HotChips 2020 that is designed and produced in collaboration with Samsung Electronics. Kunlun is capable of catering to diverse AI workloads and claims to have three times more performance than NVIDIA AISoCs. It will be interesting to see how Baidu goes all in-house with AISoC designs.

    Facebook: There are 2.7 billion people that used Facebook every month. To serve the growing requests, Facebook has been developing in-house silicon that takes advantage of AI to provide faster training. Zion, Kings Canyon, and Mount Shasta are three major AISoC that Facebook has innovated to run its hardware infrastructure efficiently. It has ramped up its effort to develop more in-house AISoC, and the results will be out in the coming years.

    Huawei/HiSilicon: A subsidiary of Huawei, HiSilicion has been innovating fast to cater not only to the AI smartphone and data center market in China but also in the majority of the developing nations. The Kirin and Ascend line of products has done wonders for Huawei devices. Huawei has also launched AISoC for data centers. It will be vital to see how Huawei and HiSilicon innovate in the next few years and expand their AISoC portfolio.

    IBM: IBM has been a quiet leader in smart technologies. Watson has done wonders for the AI industry and also pushed other companies to innovate faster. IBM has innovated to accelerate DNN training with the help of CMOS and new AI Cores. IBM has been focusing on Analog and Digital AI cores that enable dynamic and hybrid cloud systems. IBM is one of the few companies that not only provide AISoC based solutions but also innovates at the transistor level. The combination of two allows it to provide more efficient AI solutions than others.

    Imagination Technologies: Imagination Technologies has also ramped up its AI chip efforts. Recently, it launched a new AI-powered BXT series of chips for data centers. PowerVR backed line of products have helped Imagination Technologies establish its foot in the vision processing domain. PowerVR solution combined with Neural Network Accelerators (NNA) is unleashing new ways to process vision data and will also enable new AISoC.

    Intel Corporation: Intel is a leader in the server and data center SoC market. Even though it is getting stiff competition from other vendors, Intel has been able to provide the industry with breakthrough AI chips. Even though the Nirvana series of AI chips did not work out as planned, it has big planes with Habana’s line of products. The manufacturing capability of Intel allows it to ensure that there is always a new way to design and manufacture AISoC. Intel Xeon’s line of products has also shown how the AI world how smaller SoCs are capable of running workloads on high bandwidth memory. With shrinking transistor size and Intel’s plan to move beyond 7nm, there will be elegant AISoC coming out.

    Infineon Technologies: Infineon Technologies is going big in the AI Chip domain. It has established an AI development center in Singapore and also has a series of MCU designed with AI in mind. Low-cost MCU running with AI capability is the perfect solution for portable smart devices like cameras, drones, and smart speakers. AISoC with inbuilt MCU is another avenue Infineon is capable of exploring.

    Marvell Technology Group: Marvell has launched a series of ASIC-based accelerators to cater to the AI data demand. The custom ASIC solutions used high speed interconnects and innovative packaging to optimize performance and cost. On top, Marvell has a strong collaboration with TSMC to provide 5/7/14 nm AI ASIC that allows it to pitch a wide range of portfolio to the growing AISoC market. 

    MediaTek: MediaTek’s Helio line of AI chips for edge computing on the go. It is also planning to use the solution for the 5G market. Apart from the hardware products, MediTek also provides hardware-oriented design solutions like NeuroPilot to make the most of its AISoC with AI Processing Unit (APU).

    Microsoft: Microsoft hardware division has provided many AISoC solutions to the market. Project Brainway is another such solution that allows the use of FPGA and ASIC to speed up the training. Microsoft also has plans to develop a tiny AI chip in collaboration with Sony. It may very well pave a new way for nanoelectronics well beyond what is available now.

    NVIDIA: GPUs have single-handedly accelerated the growth of AI research. NVIDIA has been one of the leaders that showcased how to train the data set faster using GPU architecture. Apart from catering to the data centers, NVIDIA also provides AI-enabled SoCs for smart cars. A few months back, NVIDIA also unveiled cost-efficient A100 architecture for the industry. With ARM’s acquisition, NVIDIA is on track to bring AI to the low power AISoC soon.

    NXP Semiconductors: NXP has several MCUs and MPUs optimized for AI applications and targeted for the automotive and smart industry. NXP’s i.MX series provides ML and DL optimized solutions. With growing semiconductor cost in automotive, NXP is stand to get the advantage with is a wide range of AI-enabled AISoC chip solutions.

    Qualcomm: As mobile AI is growing, Qualcomm is taking advantage of it by providing On-Device AI accelerators. Qualcomm has also taken steps towards a cloud AI Chip solution. It launched Cloud AI 100 chips to showcase its new architecture design for AI and data centers. Stronghold on mobile business with already out AI chips, Qualcomm can spring a surprise and enable new data centers that are not only AI-enabled but are also low-power and efficient AISoC.

    Samsung: Samsung has fingers in many pies. From the design of chips in-house to the capability of manufacturing chips for its products and the world. Like Qualcomm, Samsung has been pushing for an AI chip to enabled On-Device AI. It has also collaborated with Baidu to develop a server-class of AISoC. The advantage of owning a foundry allows Samsung to innovate end-to-end and will be vital to see if it goes in the data centers’ AISoC chip design and development.

    Tesla: Tesla already has the smartest AI-enabled cars out in the market. It has already designed in-house an AI chip to cater to Tesla’s growing need to provide more advanced and safe autonomous car driving solutions. Rumours says that Tesla would do away with cars and focus on an AISoC solution that can make any vehicle an autonomous one. Whether or not it will end up happening, Tesla’s AISoC will push the innovation around the self-driving car.

    Texas Instruments: Like NXP and Infineon, TI is also providing Edge AI chips that cater to the 5G market. TI’s manufacturing capability fueled with low power techniques is going to provide a way forward to the industry on how to innovate AISoC with low power consumption.

    The above summary shows how established companies are innovating and launching AISoC. The cost to establish a FAB-LESS semiconductor startup has gone down. The advanced EDA tools provide the ability to test ideas in the shortest possible time. RISC-V open ISA is also helping innovate without investing in royalty based ISA. 

    All this has lead to an increase in the number of FAB-LESS semiconductor startups that are coming up with new semiconductor chip designs and solutions to cater to the AISoC market. These startups have already got traction and some are even collaborating with established companies to test the solutions. 

    Below is the list of some of the top startups coming up with silicon level technology to drive AISoC design:

    AlphaICs: AlphaICs is focusing on Edge AI and has designed an AI Processor that finds application as both the mobile and the data center solution. AlphaICs call their AISoC as Real AI Processor (RAP)

    Alphawave: Alphawave provides Digital Signal Processor (DSP) solutions that are suited for high-speed performance and are low on power consumption. DSP provides audio/video processing and with Alphawave’s AppolloCORE IP semiconductor companies can build AISoC with an onboard accelerator. Alphawave was also the winner of TSMC’s Awards for Excellence in Accelerating Silicon Innovation

    Blaize: Blaize is another startup providing Edge AI solution that is built for AI workload. Blaize’s Graph Streaming Processor (GSP) is a power-efficient and adaptable core that caters to AI, ML and DL need on the fly.

    Cambricon Technologies: Cambricon used to provide processors to Huawei before it began its own in-house silicon design house HiSilicon. Since then, Cambricon has developed several general markets AI products catering to mobile and cloud. Their Cloud AI platform provides flexibility and adaptability. With more than 100 million smartphones and servers powered by Cambricon, it is going to be vital for the AISoC world.

    Cerebras Systems: Cerebras uses Wafer-Scale Engine technology to deliver a supersonic deep learning experience. It is benchmarked to be 1000 times faster than a GPU. Cerebras unique interconnects, memory, and package technology is pitched to break many records in computing shortly.

    EdgeQ: EdgeQ is taking a different approach to Edge and 5G by fusing both into a single AI-powered chip. This will massively off-load the tas from data centers to Edge Computing. With 5G rollout already in progress worldwide, the solution is at the right time for the right market.

    GrAI Matter Labs: GrAI Matter is targeting robotics, X-Reality, and the drone market by providing Edge AI Processor. The solution provided by GeAI Matter has ultra-low latency and is low power, two features critical for Edge processing.

    Graphcore: Graphcore has accelerator products that cater to machine learning and artificial intelligence by leverage the proprietory Intelligence Processing Unit (IPU) technology.

    Groq: Groq leverages Tensor Streaming Processor (TPU) to provide small programming cores that are packed in a tiny package with high-speed memory and performance fast operations.

    Hailo: Hailo is one more startup focusing on Edge AI. Hailo claims its Hailo-8 Edge AI processor can provide 26 tera-operations per second (TOPS) without comprising the area and power efficiency.

    Horizon Robotics: Journey and Sunrise processor architecture from Horizon Robotics is designed to provide an AI-enabled Brain Processing Unit (BPU). Journey BPU is designed for the automotive industry, while Sunrise is for the IoT market.

    Kneron: Kneron provides Edge AI solution and plans to take on Google and others with its AI-enabled chip. Kneron claims its KL720 AI SoC has the highest performance to power ratio in the market.

    Lightelligence: Lightelligence is taking a photonics approach to solving AI processing problems. It has already released an optical AI accelerator but yet to see mass production for the market needs.

    Lightmatter: In the same domain as Lightelligence, Lightmatter also plans to use electronics, photonics, and algorithms to provide processor and interconnect that is faster and more efficient than traditional AISoC.

    Luminous Computing: Still in stealth mode, Luminous also plans to leverage photonics to speed up A workload training.

    Mythic AI: Mythic uses Intelligence Processing Units (IPUs) to provide power-efficient, performance-oriented, and cost-efficient AISoC. Mythic Analog Matrix Processor is already available to order and will find use in Edge AI.

    NUVIA: NUVIA is a stealth mode startup focusing on ARM-powered CPUs to drive AI workload. More details about its architecture are yet to be known.

    SambaNova Systems: SamaNova is another startup that uses Reconfigurable Dataflow Unit (RDU) to enable new models without going into the algorithm complexity. SambaNova’s Cardinal SN10 is designed to eliminate constant data caching and excess data movement, something the majority of the SoC today suffers from.

    SiMa.ai: SiMa wants to make greener low-power AISoC for Edge AI. It is yet to share product details. SiMa plans to launch new silicon early next year.

    SimpleMachines: To accelerate AI/ML/DL application performance, SimpleMachines leverages Composable Computing. Simple Machines AISoC solution enables flexible and powerful real-time computation.

    Synthara AG: Synthara leverages RISC-V ISA to provide ultra-low power ASIC for Edge AI.

    Syntiant: Syntiant provides an ultra-low power AI processing solution for any battery-powered device, from earbuds to laptops. Syntiant Neural Decision Processors™ (NDP10x) is a tiny silicon that is always-on.

    Tenstorrent: Tenstorent Grayskull AISoC fast AI interference to enable accurate and faster prediction on the go. It is expected to into production soon.

    Wave Computing: Wave wants to accelerate AI computing with the help of MIPS architecture. The M-Class product from Wave Computing provides AISoC using MIPS architecture for IoT and smart devices.

    Both established companies and startups are showcasing the world’s new way to design chips and drive data processing. All this is making software development, training, testing, and data analytics faster. The AISoC from all these vendors is also providing avenues for low-cost AI-powered mobile and data centers.

    However, there are several challenges ahead.

    Picture By Chetan Arvind Patil

    THE CHALLENGES AHEAD FOR AI SEMICONDUCTOR CHIPS

    The majority of the challenges the AISoC face are still the same old problems faced by general-purpose CPU and GPU as the technology at the silicon level advanced. The new AISoC solution from both the established companies and startups are eventually going to hit with these challenges.

    Cost: Designing and establishing AISoC proof-of-concept using the software simulator demands resource and pushes the cost of development from FAB to OSAT. The cost of owning smartphones and running data centers is already high. On top of it, any new solution with AI-power will add cost to the customer. The technology node required to enable a high number of processing units to speed up the training and inference is eventually going to cost money. AISoC vendors need to balance the cost of manufacturing in order to breakeven the market. On top of all this, the amount of competition in developing new AISoC means time to market is vital than ever.

    Bottleneck: The reason to move away from general-purpose CPU and GPU was memory and interconnect bottleneck. There are few startups listed above that are trying to remove these bottlenecks. However, with the speed with which new AI-workload are getting generated, there is a high chance that bottlenecks will still exist. It will be vital to ensure that the new type of AISoC that both the established companies and startups are envisioning does not have any bottlenecks.

    Bandwidth: Bringing the data closer to the processing units (any type) is the key to processing AI data faster. However, for such a task high-speed memory with large bandwidth is required. The new AISoC are incorporating new processing units like RAP, GSP, TSP, BPU, AMP, RDU, NDP, and so on, but there is no clear strategy and details on how the data communication bandwidth is improved. May be such details are proprietary. 

    Programming: In the end, any AISoC cannot process the data efficiently if the workload is not optimized for the target architecture. While few AISoC is pitching their products as no need to change the data or framework before running it on their architecture, however, the reality is that every architecture ends up needing some or other form of optimization. All this adds to the time to develop data solutions. 

    Manufacturing: As the new AISoCs come out in the market, many of these will end up using advanced nodes beyond 7nm to provide high speed. Advanced packaging technology also is required to operate the AISoC within the thermal budget. Both the complex technology node and package technology will drive a high manufacturing cost. Apart from this, balancing yield and cost will be essential to ensure AISoC development is viable.

    Power Consumption: AISoC requires zillions of transistors that require faster cooling. The majority of the AISoC can do with liquid cooling but when such AISoC is connected together to form data centers then the cost to run data centers goes high. Hopefully, greener technologies will be able to run such data centers. However, the AISoC will get challenged to overcome the area, power, and thermal wall.

    No matter what, AISoC in coming years is going to be the semiconductor domain that will innovate and provide elegant semiconductor solutions that will challenge the end-to-end semiconductor design and manufacturing.

  • The Need For Semiconductor As A Service

    The Need For Semiconductor As A Service

    Photo by Laura Ockel on Unsplash

    THE SEMICONDUCTOR AS A SERVICE

    The software industry has adapted to the demand of business and consumers by changing the licensing and product delivery model over the last three decades. The post-1990 saw standalone one-time fee-based software with no incremental feature updates except security-related and termed as the pay and use model. Then post-2000, with the proliferation of the internet, the software license model moved to pay over month/year and also came with features and security updates. The software industry termed it as Software-As-A-Service Model. Post-2010, the software industry adapted to the changing business and applied the licensing model from software to platform, which came not only with features and security updates for the software itself but also the platform the software will run on. It has allowed software developers to provide more over the top services.

    In comparison to the software industry, the hardware industry (mainly the semiconductor industry) has not adopted the product delivery model. It has been constant and driven by build and ship, with no ability to provide new hardware features on the go. If there are security flaws in the hardware, then those are suppressed by an Over-The-Air (OTA) update. Consumer and business buying the piece of silicon get locked in with the product. It is also not easy to provide new features at the silicon level. On top, the majority of the products shipped by the semiconductor industry end up getting used differently based on the hardware company’s need. 

    The semiconductor products (from CPUs to NPUs to GPUs to ASICs to FPGAs to DSPs to Mixed/Analog/Digital devices) have a long design and manufacturing cycle. It also means a long-term vision of the future market needs and then aligning the investment in the design to the manufacturing process accordingly. As per the market demand, semiconductor products need to be more adaptable with in-built features that are more relevant a few years down the line and can be activated post-production.

    Semiconductor-As-A-Service Is Possible Today Than Ever Due To The Shrinking Transistor Size That Allows More Silicon Features To Be Built-In Today For The Future Needs.

    The approximate life of a smartphone is anywhere between three to five years. However, the majority of companies stop providing critical software updates that make the smartphones redundant. The launch of new smartphones with new silicon and software grabs consumer’s attention and they end up buying a new smartphone with the latest silicon features.

    Imagine, having adaptable silicon with features built-in that can be unlocked a few years later and thus making the hardware as new as the software? Either vendors or consumers can decide which silicon features should be activated and how it helps the device performance. Such a process will allow the semiconductor industry to deliver silicon services under Semiconductor-As-A-Service model.

    Semiconductor-As-A-Service – A product delivery business model for the semiconductor industry which allows silicon design and manufacturing with in-built silicon features that can be unlocked in the future as the market demand and software requirements align. For example – More graphics for new gaming applications. These silicon features can be enabled with the help of software updates and require a subscription or one-time payment license. The list of features can be endless, from more cache memory to DRAM memory to extra processing cores to additional GPU for gaming applications to secondary cellular (perhaps 6G) antenna. The shrinking transistor size and growth of heterogeneous integration as a More-Than-Moore (MTM) solution makes such features in silicon possible. Silicon area with extra features can reside inside the smartphone launched in 2020 as an inbuilt hidden feature with the option to enable in 2022 as long as consumers are willing to pay. Such service can also be bundled with software features wherein the smartphone manufacturers can tie the new feature like extra memory or storage.

    Picture By Chetan Arvind Patil

    THE PROCESS OF SEMICONDUCTOR AS A SERVICE

    Semiconductor-As-A-Service implementation can unlock a plethora of opportunities not only for the semiconductor industry but also for the software industry. However, implementing Semiconductor-As-A-Service requires a specific process to be followed from designing to manufacturing. It also requires the semiconductor industry to take risks by providing advanced technology node use today rather than a few years down. Using advanced technology is the key to fitting more silicon features that can be unlocked post-production as it allows more silicon in the smallest possible area as this helps in providing more features at the transistor level.

    Semiconductor-As-A-Service Process:

    Identify Future Software Needs – These software features should be those that become bottlenecks for consumers. It can be from understanding whether the consumers will need more memory than the product has been shipped with so that with the growing data-driven application enabling an extra memory at the silicon level can cater to the software demand. The same goes for CPUs and GPUs for processing power.

    Design Silicon With In-Built Hidden Features – Post identification of future software needs, packing the silicon with features that get unlocked in the future. The majority of these features will reside inside the System-On-A-Chip (SoC), as the active components are the ones that can provide more benefits of service-based features than passive components. Usage of advanced technology node is key to enabling such silicon level features.

    Ability To Enable The In-Built Hidden Silicon Features – Incorporating the in-built hidden silicon feature requires not only designing it with secure memory to store keys to activate features but also requires a secure manufacturing process. The secure way of design and manufacturing ensures that there are no security flaws that can be exploited by hackers.

    Innovative Manufacturing And Packaging – The critical piece of the Semiconductor-As-A-Service process is to ensure that the manufacturing flow and the packaging technology use advanced techniques to consider the effects when more silicon area is activated. Activating new features (more memory or processing capability) can have significant power and thermal effect.

    Product Cost: Planting more silicon with the expectation that it will get used in the future under a pay-as-use service is a business risk. It is vital to price such products so that the design and manufacturing costs invested gets recovered even when in-built hidden features do not get utilized.

    Above are the five key process steps that lay the foundation of Semiconductor-As-A-Service. It has the potential to make the silicon more adaptive. It will require massive research and development before the industry can use it as a real-world solution.

    Picture By Chetan Arvind Patil

    THE NEAR-TERM IMPACT OF SEMICONDUCTOR AS A SERVICE

    If Semiconductor-As-A-Service is implemented and widely used, then it has the potential to transform the computing industry.

    The ability to enable an extra layer of processing power on the go provides a new way to process data. With 3.5 billion 5G subscribers by 2026, the data consumption will skyrocket, and having silicon with in-built hidden features to cater to such high processing and memory demand will take computing to another level. Semiconductor-As-A-Service can also enable date centers and OEMs vendors with avenues to save cost and increase revenue by providing silicon level services.

    Semiconductor-As-A-Service Provides Avenues To Put Future Silicon Technology In Today’s Silicon Area

    FABs, FAB-LESS, IDMs, OSATs, and ATMPs will be able to use technology designed for future silicon today. It will help them understand its impact and usage before launching future silicon technology on a large scale. The semiconductor industry has already started embracing chiplets and heterogeneous computing. These two semiconductor and computing techniques can provide a perfect starting point where more silicon can be incorporated to use it in the future.

    IP based semiconductor business is going to benefit the most as it will allow designers to incorporate more features that can be locked and unlocked as per the need. FAB-LESS companies will make more business by providing vital features as-a-service.

    Semiconductor-As-A-Service also means every device out in the market is different than others as silicon features can be enabled and disabled to the consumer’s liking.

  • The Importance Of End-To-End Semiconductor Cluster Ecosystem

    The Importance Of End-To-End Semiconductor Cluster Ecosystem

    Photo by Laura Ockel on Unsplash

    THE END-TO-END SEMICONDUCTOR CLUSTER ECOSYSTEM

    The semiconductor industry is vital for high-tech advancement. From smartphones to satellites, a small piece of silicon forms the base for millions to trillions of data points. It is why worldwide, the semiconductor industry is a Key Enabling Technology (KET) provider. Semiconductor product development requires various resources to come together. With the growing demand for smart hardware, the need to develop these resources in-house is more critical than ever.

    In semiconductors, no single country wants to be 100% reliant. Countries are ramping up in-country semiconductor design and manufacturing efforts.

    The complexity of both the design and the manufacturing aspects of semiconductors makes it a tough business. It takes years and decades to come up with a turnkey ecosystem to drive in-country semiconductor design and manufacturing. The cutting-edge technology that is required to become self-reliant in semiconductor design and manufacturing demands a radically different approach than incentive-based schemes, which the majority of the governments provide.

    The End-To-End Semiconductor Cluster Ecosystem Requires In-Country Development And Growth Of Semiconductor To Drive Key Enabling Technology

    End-To-End Semiconductor Cluster Ecosystem: An end-to-end semiconductor design, manufacturing, and support ecosystem that enables seamless semiconductor product development. It requires different components of the semiconductor product development to be done in-country rather than globally. It drives in-country economic and talent development and is cost and time effective.

    The End-To-End Semiconductor Cluster Ecosystem is what countries should focus on building to pitch themselves as a one-stop destination for all semiconductor solutions. However, it is easier said than done. The list of different types of resources and solutions that are required to develop a semiconductor cluster ecosystem is long. Depending upon the market size and focus area, countries can have a different smaller focused end-to-end semiconductor cluster ecosystem that has all the components of semiconductor design to manufacturing to customer delivery.

    Picture By Chetan Arvind Patil

    THE COMPONENTS OF THE END-TO-END SEMICONDUCTOR CLUSTER ECOSYSTEM

    Creating a semiconductor cluster ecosystem is not easy. There are different components required to ensure that the environment supports the semiconductor business. Following are the major components of the semiconductor cluster ecosystem:

    RESEARCH AND DEVELOPMENT

    Research and Development (R&D) is key to both basic and applied science innovation. R&D requires the cooperation of government, academia, and industry. Given how complex semiconductor product development is (from technology node to packaging to power requirements), continuous and steady R&D spending is vital as it forms the base of the semiconductor cluster ecosystem.

    According to the Semiconductor Industry Association, in 2019, the U.S. semiconductor industry R&D spending was 16.40% of total sales. Europe spending was 15.30% of total sales, while Taiwan, Japan, China, Korea spending was 10.30%, 8.40%, 8.30%, 7.70%, respectively. It clearly shows the importance of R&D spending and how it helps drive the leadership in the semiconductor business.

    Countries wanting to implement the semiconductor cluster ecosystem need to increase R&D spending by collaborating with academia and industry, to drive advanced solutions for the market.

    DESIGN (FAB-LESS/EDA/IDM):

    Without the semiconductor design, there is no manufacturing. Countries around the globe are attracting businesses to design in-country. This requires setting up of FAB-LESS business which can drive the design of Analog, Digital, Processor, Memory, and Sensor-based products. To cater to the needs of FAB-LESS, EDA companies are required who can provide software-based tools to drive circuit to layout design, simulation, and validation. Apart from FAB-LESS, there are several IDMs (Intel, NXP, Marvell, etc.) which cater to the need of both the design and manufacturing aspect of the semiconductor.

    The development of an in-country design ecosystem requires a talent pool. This demands universities with excellent infrastructure that can provide deep technical training required to drive gain expertise in semiconductor engineering.

    MATERIAL:

    No FAB or OSAT in the world produces the materials required to bring the silicon to life. Different chemicals, silicon, photomasks, gases, substrates, compounds, etc., are required to develop the wafers and packaged materials. There is a big dependency on specific countries and companies that provide such materials.

    Semiconductor material development and procurements also mean a good understanding of the engineering aspect and as said it requires heavy R&D activities within the country where the materials eventually will get used, either by the FAB or the OSAT.

    EQUIPMENT:

    Semiconductor equipment is a billion-dollar market. Both FAB and OSAT require heavy machinery to process and assembly wafer silicon. ASML is the largest supplier in the world of lithography systems for the semiconductor industry apart from ASM, Applied Materials, and TEL. On the other hand, ADVANTEST, TEL, and Teradyne are the largest supplier of ATE-related equipment.

    Both FAB and OSAT equipment are vital to ensure the materials and design eventually get made in the form of a product. A country with a stronghold on the semiconductor equipment manufacturing market is key to anything semiconductors.

    FAB:

    Fabrication of semiconductor devices requires dedicated facilities with large clean rooms. The investment to create such a facility is big and is the primary reason why there is only a handful of semiconductor FAB around the world. Even out of the existing FABs, not all are equipped to handle the advanced technology node that the semiconductor industry has ventured into.

    TSMC, Intel, GLOBALFOUNDRIES, and Samsung Semiconductor are competing with each other to grab the opportunities presented by technology node 5nm and beyond. To make countries self-reliant in semiconductor, FAB play a vital role. It has pushed governments without any FAB facilities to provide incentives to set up new advanced FAB. However, setting up FAB also requires a supporting ecosystem, and this is why countries should focus on the cluster-based ecosystem that provides in-country end-to-end semiconductor solutions.

    OSAT:

    Outsourced Semiconductor Assembly And Test (OSAT) is as important as FAB. Packaging the products with the right technology enables long life. Testing every die on the wafer is vital to ensure there is no reliability or test escape. OSAT enables defect-free parts to the customer. They drive the back end of semiconductors, which in itself is a billion-dollar market.

    Historically, OSATs have been located in the Asia Pacific and have been dependent on America and Europe due to the R&D and design lead these two continents hold. For a semiconductor cluster ecosystem, all the major components need to be catered to, not only specific ones. This is why OSAT is trying to get into FAB and is also investing in in-house design.

    ATMP:

    Assembly, Testing, Marking, and Packing (ATMP) is different than OSAT. OSATs take the bare wafer silicon and convert it into a packaged product, which is then shipped to the ATMP houses. ATMP receive packaged semiconductor products from different OSATs and then they assemble it together on a printed circuit board (PCB). All the semiconductor devices are connected to form a working computer system and clear marking details are put on the PCB to ensure traceability of devices. As the last step, the PCB is covered with an aluminum or plastic body before being shipped to the customer in a fancy box.

    China is the leader in ATMP. India is another upcoming destination. Dell and Foxconn are the world’s largest ATMP houses. Having ATMP houses in-country provides economic development but at the same time negates the benefits when a country becomes 100% importer of semiconductor products. This is what has happened with India’s ATMP ecosystem.

    MISCELLANEOUS:

    Apart from all the major components, there are some crucial minor components that are also critical for the semiconductor cluster ecosystem. These include logistics, distribution, and enterprise-level software. Having delivery and development houses for these activities is also critical in ensuring an end-to-end semiconductor cluster ecosystem. Given these solutions are driven mostly by software in today’s day and age, the majority of countries have both development and R&D centers catering to the future of how to efficiently to logistics to distribution with the help of data and software.

    SUMMARY: End-to-end semiconductor cluster ecosystem requires all of the above components to be in close proximity. However, as of today, there is not a single full end-to-end semiconductor cluster ecosystem in the world. The majority of the semiconductor cluster ecosystem has one or max three of the above components. Given the race between countries to attract the world’s best semiconductor business and talent, the focus on the end-to-end semiconductor cluster ecosystem needs to increase by leveraging facilities within the same location or country. Having more FABs and then relying on other countries for OSATs and ATMPs is never going make a single country the destination for all semiconductor needs, and that is what the majority of the countries in the last two to three years are trying to achieve. Unfortunately, that is not possible till an end-to-end semiconductor cluster ecosystem is built in-country.

    Picture By Chetan Arvind Patil

    THE ACTIVE SEMICONDUCTOR CLUSTER ECOSYSTEM

    There are a handful of semiconductor cluster ecosystems located in different countries. However, these clusters do not cater to all the components discussed above. It will not be valid to call these centers a semiconductor cluster ecosystem, but it does show the importance of having one or more semiconductor components within vicinity.

    Following are a few active semi semiconductor cluster ecosystem but not end-to-end:

    Intel – Portland, Oregon, USA And Chandler, Arizona, USA: Intel has advanced FABs in Portland, Oregon, and Chandler, Arizona. There are two big universities in the proximity of these two FAB locations: Portland State University and Arizona State University. Cross-industry and academia collaboration at these two locations have to lead to the launch of several innovative semiconductor solutions. The exchange of talent for research activities has also helped. Intel’s presence in these two locations guided the formation of a semiconductor support environment that has helped its FAB execution. This is also the primary reason why TSMC has chosen Arizona as the destination of their next 5nm plant.

    ASE Global – Kaohsiung, Taiwan: ASE Global has multiple OSAT facilities in Taiwan. Kaohsiung plant stands out due to the proximity to other package technology solution providers like Amkor. The competition has helped with the development and availability of the semiconductor raw materials required to smoothly operate an OSAT facility.

    TSMC – Hsinchu, Taiwan: TSMC has several FABs around the globe with the majority of the FABs located in Hsinchu, and has helped TSMC develop an ecosystem that has allowed universities and OSAT nearby to thrive. Having OSAT and FAB in the same location also reduces the cost and time of product development.

    Newport Wafer Fab – Newport, United Kingdom: Newport Wafer Fab is the latest addition to the semiconductor ecosystem and promises to be the one-stop FAB needs for the UK region. It has tied up with Cardiff University to enable future compound semiconductor development. Showcasing why having universities nearby helps.

    Samsung – Gyeonggi, China: Samsung like TSMC has FABs in a different part of the world, with the majority located in Gyeonggi. China being home to both the OSAT and ATMP houses, has allowed Samsung to take advantage of the in-country ecosystem of semiconductors.

    TAKE AWAY: Above examples show the importance of having one or more semiconductor cluster ecosystem components in proximity. Imagine having all the semiconductor components in one location and that too within a single country. The benefits from employment, development, and growth will be immense. Whether or not such an ecosystem will end up getting developed, but for sure, countries are racing to attract the best talent and semiconductor businesses to drive in-country semiconductor growth.

    Picture By Chetan Arvind Patil

    THE WAY FORWARD FOR END-TO-END SEMICONDUCTOR CLUSTER ECOSYSTEM

    The semiconductor industry is going through massive critical changes. From mergers to acquisitions to new companies to new FABs, all this is shaking up the semiconductor business.

    Traditionally, semiconductor design and manufacturing has been all about specific regions/countries in the world having a stronghold on either the design or manufacturing or equipment. Post-2020, the story is going to change. Majority of the country has already started chasing giants of the semiconductor industry to set up their designs for manufacturing houses.

    Country With The End-To-End Semiconductor Cluster Ecosystem Will Lead In The Digital Technology World.

    Governments need to develop their country as an end-to-end semiconductor cluster ecosystem, with a solution for every component of the semiconductor development cycle. Having one facility and not the other is only going to make the new facilities in the new country dependent on the old facilities in other countries.

    The country that can create an end-to-end semiconductor cluster ecosystem is going to have an advantage over others and will lead the digital technology competition.

  • The BIG-5 Are Becoming Semiconductor Companies

    Photo by İsmail Enes Ayhan on Unsplash

    THE NEED TO PROCESS DATA

    Internet usage is growing. Every new user generates a new type of data. The technology companies are always eager to process and understand new consumer behavior. It requires continuous research and development of both the software and the hardware.

    Software development has advanced in the last two decades. It has kept pace with the need to understand and process data due to the development of software libraries and frameworks. The large amount of data that has generated post-2010 has helped the Deep Learning (DL), Machine Learning (ML), and Artificial Intelligence (AI) frameworks train networks, and that is now allowing new data to be processed faster and accurately.

    Hardware is vital in ensuring that the processing of data using training and prediction frameworks occurs in the shortest time possible. It requires a massive amount of computing. The majority of the technology companies now rely on massive data centers equipped with advanced computer architectures.

    BIG-5 – Facebook, Amazon, Apple, Microsoft, Google – FAAMG

    To fully utilize computer architectures, an in-depth architecture-level understanding is required. It is not always possible to do so, as the data centers still run general-purpose computer architectures that do not cater to different types of data the big technology companies have to process.

    The disconnect between the software, the hardware, and the data has promoted the need to move from General-Purpose SoC To Application-Specific SoC. Not all data companies are capable of setting up a dedicated team that can focus on in-house silicon development to come up with an Application-Specific SoC.

    To overcome the reliance on semiconductor companies, the BIG-5 (FAAMG) technology companies have started (or have already developed) developing in-house SoC with the hope of opening up the silicon to different data companies around the world.

    Picture By Chetan Arvind Patil

    THE PUSH FOR IN-HOUSE SILICON

    Two major factors drive the push to develop new computer architectures (silicon):

    • Memory
    • Parallel computing

    Memory:

    • Modern applications are becoming memory intensive and also demand faster computation. To process requests from memory-intensive applications in the shortest possible time, the data needs to reside closer to the processing unit.
    • The time to bring the data from SSD to DRAM to Cache adds cycles and delays processing of the data. To overcome such bottleneck, semiconductor companies have implemented the following three techniques:
      • Cache Prefetching:
        • Bring the data near the processing unit in advance to minimize cycle time
      • Increasing Level Of Cache:
        • Add Leve-1 (L1), Level-2 (L2 – Shared), and Level-3 (L3 – Shared) small (KB/MB) cache memory to improve memory prefetching speed
      • Enable High Bandwidth Memory:
        • An extra layer of large high-speed memory between Last Level Cache (LLC – Either L2 or L3) and DRAM to speed up prefetching
    • All the above three techniques improved the response time of processing units. However, as the application data started growing, the cache and memory trashing became a new hurdle.
    • Multiple processing units sharing the same level of memory started corrupting each other’s data to process the request faster. On top of all this, the lack of interconnect bandwidth added further bottlenecks.

    Parallel Computing:

    • Apart from being memory intensive, applications have become compute-intensive too. It prompted the need to have multiple processing units within the same SoC. Running multiple data requests on a single processing unit or two separate processing units provided a way to accomplish the task in the shorted possible time.
    • The processing units still relied on the low-level memories to bring the data to be processed quickly. It means new SoC designing techniques that can allow the sharing of cache and high bandwidth memories in elegant ways without compromising on the need to add latency.
    • Adding more processing units to a single SoC is not the solution. On top, the developers have to keep comping up with smart ways to distribute the data to multiple SoC to speed up the processing.
    • Distributed computing is what the majority of the technology companies have adopted to ensure the data is processed quickly. It means a massive number of servers with thousands of SoC and a large amount of memory. Over time this has increased the cost of operating data centers.

    Even though in the last decade, semiconductor companies have come up with unique computer architecture to cater to both memory and compute-intensive applications, it has not been enough to adopt the changing processing requirement of BIG-5.

    The need to handle memory and parallel computing demand by modern workloads and applications efficiently at the architecture level has pushed BIG-5 to go for in-house silicon.

    THE STATUS OF IN-HOUSE SILICON

    BIG-5 has been gearing towards the development of adaptive computer architecture for data and operating systems.

    Facebook:

    Facebook started working on in-house silicon a couple of years back. With a growing user base across multiple platforms (Instagram, WhatsApp, Messenger), Facebook ramped up silicon effort last year.

    They have a silicon team that is focusing on Application-Specific SoC development that not only caters to data centers but also portable devices like Oculus.

    Amazon:

    Amazon Web Services (AWS) is one of the leaders in cloud solutions. The desire to have customized SoC is vital to ensure the consumers and enterprises can make most of the wide range of computing services AWS provides.

    Apart from AWS, Amazon’s growing range of Echo products is also pushing it to drive in-house silicon development. Amazon is betting big on ARM architecture to drive its silicon needs.

    Apple:

    Apple was always into silicon development. This year with the Apple M1 launch, they are making big bets on in-house silicon development that caters well to their need.

    With Siri about to become the default search option on all the Apple devices, the need to have data-centric customized silicon will grow.

    Microsoft:

    Microsoft always had a keen interest in hardware. They already have a strong team of researchers focusing on hardware research. The Surface line of products has shown strong growth, and the SQ1 line of SoC establishes Microsoft’s goal of making Windows smoother to use on silicon.

    Recently, Microsoft also announced a plan to develop Secure Chip with the help of semiconductor giant Intel and AMD.

    Google:

    Like Microsoft, Google also has a dedicated team that has heavily contributed to silicon development via different computer architecture domains. They have already announced plans to develop in-house silicon for Pixel and Chromebook devices.

    A few years ago, Google showcased the world Tensor Processing Units (TPUs) to speed up the training of data set using the TensorFlow framework. Google’s latest data shows they have been successful in doing so.

    Picture By Chetan Arvind Patil

    THE POSSIBLE FUTURE SCENARIOS

    BIG-5 is betting big on in-house silicon development. This requires not only years of planning and investments but also a dedicated semiconductor development team and flow chain. Going forward there are two possible scenarios that BIG-5 might take:

    Scenario 1:

    BIG-5 will keep collaborating with semiconductor companies (Intel, ARM, AMD, and Qualcomm) to design silicon for their products and data centers with strict control over features and the manufacturing process. It will enable BIG-5 to enter the in-house FAB-LESS business model.

    Scenario 2:

    BIG-5 will slowly move away from semiconductor companies and spin-off an in-house team with a full turnkey silicon development chain. It will be more like an IDM business model and might require the acquisition of existing semiconductor manufacturing units.

    The probability of the second scenario occurring soon is unlikely. In a decade or so, BIG-5 may go big on the semiconductor business and try to keep themselves as in-house FAB-LESS silicon developers (while owning a piece of IDMs/FABs), which will ultimately play in the hands of FAB/Pure-Play Foundries like TSMC and GLOBALFOUNDRIES.

    Whichever scenario ends up occurring, there will be exciting developments in computer architectures that will drive the semiconductor industry to new levels.

  • The Challenges And Way Forward For Computer Architecture In Semiconductor Industry

    The Challenges And Way Forward For Computer Architecture In Semiconductor Industry

    Photo by Luan Gjokaj on Unsplash

    OVERVIEW

    Computers are designed to provide real-time feedback to all user requests. To enable such real-time feedback, Central Processing Unit (CPU) is vital. CPU is also referred to as processing units or simply processors. These incredibly small semiconductor units are the brain of the computer and are capable of performing Millions/Billions of Instructions Per Second (MIPS/GIPS). High MIPS/GIPS, means faster data processing.

    A lot of processing goes on inside these processing units. With the advancement of the technology nodes, more processing units are being glued together to form System-On-A-Chip (SoC). These SoCs have different individual units like GPU, DRAM, Neural Engine, Cache, HBM, ASIC accelerators, apart from the CPU itself.

    It is incredibly difficult to design an SoC that has the best of two important worlds of computer architecture: Power and Performance.

    Both in academia and the industry, Computer Architects (responsible for design and development of next-gen CPU/SoC) play a key role and are often presented with the challenge of understanding how to provide faster performance at the lowest power consumption possible. It is a difficult problem to solve.

    The battery technology has not advanced at the speed at which SoC processing capability has. Shrinking technology node offers opportunities to computer architects to put more processing power, but at the same time, it also invites issues related to the thermal and power budget.

    All this has lead to semiconductor companies focusing on design challenges around the power and performance of the SoC.

    CHALLENGES

    Semiconductor industry has been focusing on two major SoC design challenges:

    • Challenge 1: Efficient and low latency SoC design for portable devices
    • Challenge 2: High throughput and performance oriented SoC for data center
    Picture By Chetan Arvind Patil

    Challenge 1:

    • Portable:
      • Portable devices suffer from the constraint on the battery capacity. The battery capacity has been increasing mainly due to the shrinking board inside these devices due to the shirking transistor size.
      • This has allowed the OEMs to put more lithium-ion. However, to balance the form factor and portability, batteries cannot be scaled out forever. It is a challenge for OEMs to understand how to manage portability by balancing the battery size apart from making the computer system efficient with low latency.
    • Efficiency And Low Latency
      • To tackle efficiency and low latency, innovative designs are coming out in the market with the ability to adapt the clock and voltage domain depending on the application being executed by the user. It is no more about how many cores are in the SoC, but more about how an application-specific core can provide a much better user experience than ever.
      • This has presented researchers with an interesting problem of improving the performance per watt (PPW). To improve PPW, researchers around the globe are taking different approaches around DVFS schemes, apart from improving transistor level techniques.
      • Frequency and voltage level scaling also has a direct impact on the response time. Processing units like CPU are designed to provide low latency so that all the request coming in, can be catered to in real-time.
      • Improving efficiency without compromising on the latency is still a big challenge for the computer architects.

    Challenge 2:

    • Data Center:
      • On the opposite pole, data centers are designed to be compute-intensive. The SoC required to cater data center has exactly the opposite need compared to portable devices. As companies become data aggregators, the analysis requires dedicated hardware that provides streamlined computation of the data on the go.
      • This is prompting companies like Google, Facebook, and Amazon to come up with their silicon that understands the data being generated and how to swiftly analyze it on the go.
    • Performance And High Throughput:
      • Designing custom SoC requires a fresh look and is drastically different than the block based approach. Improving throughput requires high speed interconnect to remove bottlenecks in data processing, else the performance will be affected.
      • In order to improve throughput, the data needs to reside near the computation block. This demands a new way to predict data to be used in order to bring in the cache or add a memory hirerachy with the help of MCDRAM.

    The challenges are many and researchers around the globe are already working to provide elegant computer architectures both from academia and the industry.

    WAY FORWARD

    As the need of the application running on the computer systems is changing, so is the approach to designing SoC. Various examples from different companies show how the development of computer architecture is changing and will eventually help others come up with new computer architectures.

    These new architecture designs are taking the traditional approach of computer architecture and providing a different way to tackle both memory and compute bottlenecks.

    Cerebras came up with Wafer-Scale Engine (WSE), which is developed on the concept of fabricating full wafer as a single SoC. The performance data of WSE show a promising future of how computer architecture becomes more wafer-level designing than die level. WSE also takes different approach on interconnects by utilizing wafer scribe lines to transfer data which provide more bandwidth.

    Fungible’s Data Processing Unit (DPU) architecture is another way forward that shows how SoC will be increasingly get designed for scale-out systems to handle massive data.

    Picture By Chetan Arvind Patil

    Google’s TPU and Amazon’s Inferentia shows how custom ASIC based SoC will become de-facto. Companies that generate a lot of data will try to run their center on in-house developed SoC.

    Apple’s M1 launch showed how ARM will start eating the x86 market for energy-efficient portable devices. In few years, the integration will become more intuitive and might attract other x86 portable devices OEMs who have failed to take Windows on ARM to its true potential.

    NVIDIA’s bid to acquire ARM shows that the future GPU will be designed with a blend of fusion technology that will combine ARM/CPU with GPU more than ever. This will allow data centers to improve on latency apart from focusing on throughput.

    In the end, all these are promising development for the computer architecture community. Provides numerous opportunities to research and develop new ways to enable lower latency and higher throughput while balancing power consumption.

  • The Status Of Semiconductor Manufacturing In India

    The Status Of Semiconductor Manufacturing In India

    Photo by Laura Ockel on Unsplash

    THE SEMICONDUCTOR STATUS IN INDIA

    In 2020, the semiconductor industry got a lot of attention. From geo-politics to manufacturing advancement to mergers and acquisitions, the semiconductor industry has been all over the news.

    This showed the world the growing need and dependency on semiconductor technology. This caught attention of the countries that are behind in the semiconductor fabrication, assembly, and testing. Specifically, India, which is a 100% importer of the semiconductor products/devices.

    A country with 1.3+ Billion people, simply cannot afford to be lagging in the core semiconductor manufacturing technology, which provides the base for several technology products from smartphones to satellites.

    There has been a push from the government to attract businesses all over the world to set up semiconductor fabrication, assembly, and testing facilities in India, by providing incentive based schemes. The reality is that much more is required than just the policies.

    It is not that India does not have any semiconductor fabrication, assembly, and testing facilities.

    All of the existing semiconductor fabrication facilities are owned and operated by the government of India for critical infrastructures needs like defense and space technology:

    Few private companies are in semiconductor assembly and testing but not into fabrication:

    • SPEL Semiconductor Limited is capable of providing turnkey post-fabrication testing and assembly solutions.
    • ChipTest Engineering Private Limited is another (owned by SPEL’s parent company) assembly and testing solution provider with an office in Asia-Pacific apart from India.
    • Tessolve Semiconductor also provides semiconductor testing and product engineering related services.
    • Apart from above three, there are numerous private electronic assembly (different than semiconductor assembly and testing) service providers that do not fall either in the semiconductor fabrication, assembly, or testing domain.

    Above data shows that the in-house semiconductor fabrication, assembly, and testing is yet to expand in India. There is a huge gap between supply and demand with respect to semiconductor manufacturing. On the other side, the semiconductor design industry in India is thriving with almost all of the top FAB-LESS to IDM (Design only) to ESDM design houses having R&D centers that are involved in niche semiconductor product design including PDK‘s for advanced nodes.

    This leads to the question, what are the missing links?

    Picture By Chetan Arvind Patil

    THE SEMICONDUCTOR MISSING LINK IN INDIA

    The semiconductor end-to-end manufacturing comprises of following types of semiconductor companies:

    • FAB-LESS/IDM – Pre-Silicon semiconductor product design
    • EDA – Pre-Silicon software tools and libraries to aid semiconductor product design
    • FAB/Pure-Play Foundry/IDM/Equipment/Material/OSAT/ATMP – Post-Silicon semiconductor fabrication, assembly and testing

    Pre-Silicon:

    In terms of Pre-Silicon (FAB-LESS and EDA), India has an advantage over neighboring countries due to the active participation in critical product development happening in the various FAB-LESS/EDA companies. This is important as semiconductor industry in 2020 showed clear pathway that the future will have less IDM, and more FAB-LESS and FAB companies – two different segments. There are few IDM companies in India, but these only cater the designing aspect and not the manufacturing aspect of the semiconductor product development.

    However, there are disadvantages too when moving from the designing to manufacturing phase of the product development.

    India is becoming heavily dependent on Asia Pacific countries for semiconductor fabrication, assembly and testing. On top, it is not that Asia Pacific countries are far behind when it comes to FAB-LESS designing. With matured semiconductor manufacturing, taking lead in the designing space will not be difficult.

    Post-Silicon:

    The major missing link in India’s semiconductor industry falls in the Post-Silicon domain. Without a dedicated MINI/MEGA/GIGA foundry, India lacks far behind not only in the world but also in Asia.

    Importing 100% of the semiconductor products and then simply assembling them is not viable from import/export business point of view and puts way India behind when it comes to competing in the technology domain. On top of this, the OSAT business yet to mature in India.

    Semiconductor manufacturing is vital and with critical infrastructure going digital, it is more important than ever for countries to become self-reliant.

    How To Fill The Gap:

    India does not need a GIGA-FAB which costs ~$12 Billion to setup and takes years to break-even. A MINI/MEGA-FAB focusing on specific market and targeting higher technology nodes (140nm and 180nm), might be more viable option both in terms of the cost and time.

    Indian government needs to involve or create a separate entity out of the active public semiconductor fabrication units like SCL and SITAR, and then form a partnership with the world renowned FAB companies. This is the best way to break the never ending chain of inviting private partners to setup the $ Billion facility that might never see the day.

    Starting from backward (OSAT) and then going forward (FAB) is more business friendly for India.

    To decrease the semiconductor manufacturing gap further, the policies like PLI and SPECS needs to be made more OSAT friendly, so that the global OSAT leaders can set up the manufacturing units in India on their own and link their business with the already present design houses and assembly/ATMP manufacturers.

    If India wants to stand a chance in the semiconductor post-silicon industry, then the government and private companies needs to come together faster and start the work as soon possible. It takes half a decade to envision and build a Class 1 semiconductor manufacturing facility. The clock is ticking.

  • The Semiconductor Industry Shake Up

    Photo by Jason Leung on Unsplash

    THE SEMICONDUCTOR INDUSTRY STATUS

    In 2020, the semiconductor industry has seen both negative and positive trends.

    The first half of 2020 showed mostly the negative trend driven by the COVID-19 restrictions, as it lead to slower semiconductor production and increased inventory due to decreasing sales. The second half of 2020 has been more positive. The sales have gone up and production lines are 100% occupied, to cater the newly launched devices and products by vendors across the globe.

    Apart from the steady increase in design, development, and production, merger/acquisition have gone up too. There have been some unexpected takeovers which are bound to have a strong impact in the long run.

    The semiconductor industry from a product point of view can be divided into:

    • CPU
    • GPU
    • SoC/MPSoC/RFSoC
    • ASIC/FPGA/ASSP/ACAP
    • Digital/Analog/Mixed
    • Memory
    Picture By Chetan Arvind Patil

    The mergers and acquisitions that have occurred in 2020 have affected each of the above product domains.

    All these acquisitions from the design have shaken up the semiconductor design industry. However, at the same time, it is turning out to be a boon for semiconductor manufacturing, as many IDMs plan on becoming FAB-LITE to focus more on the design aspect and increase share the mobile, AI, and data center market.

    This raises the question of how the future of semiconductor design and manufacturing is going to be.

    THE SEMICONDUCTOR INDUSTRY SHAKE UP AND FUTURE

    Taking a look from the semiconductor design point of view, it is getting clear that companies are more focused on a specific product domain and want to dominate the market. To achieve this, companies are either creating new asset via acquisition or selling old asset that do not align with the goal.

    Intel last year sold its smartphone modem business to Apple and this year Intel also decided to sell NAND memory business. This shows that Intel wants to focus on its strength of personal and data center computing. For sure, NVIDIA’s acquisition of ARM is concerning for Intel, given how much strength an established IP from ARM will give NVIDIA and also allow it to extend its business from GPUs to CPUs, and that too smartphone business which is not Intel’s primary domain.

    On top, with AMD’s solid performance and acquisitions, the fight for smart computing is going to heat up. AMD (since 2009) and NVIDIA are FAB-LESS semiconductor companies. This allows AMD and NVIDIA to focus more on the design aspect and let external manufacturers take care of the manufacturing. This is a big advantage as semiconductor manufacturing is hard and takes a long time to perfect.

    Picture By Chetan Arvind Patil

    All these points towards a major shake-up that will occur in near future. The business mode; will change and semiconductor companies will go either:

    • FAB-LESS
    • FAB/Pure-Play Foundry

    Competing in both the arena as a single entity is going to be challenging. Spinning off or selling part of the semiconductor manufacturing might be a more viable solution. Such shake-up will eventually end up creating more business for the semiconductor manufacturing companies and they will have to predict today and start planning on increasing the capacity (or acquisition) to keep the business running.

    It will be vital for countries like India to take advantage of such market business change by coming out with policies that heavily incentivize semiconductor manufacturing.

  • Indian Automotive Industry Can Drive Semiconductor Manufacturing In India

    Photo by Amin Khorsand on Unsplash

    India’s automotive industry is the world’s largest two-wheeler, three-wheeler, and tractor manufacturer. It is also the world’s second-largest bus manufacturer, third-largest heavy truck manufacturer, and fourth-largest car manufacturer.

    With the advancement in automotive solutions that will enable sensor-based safe assisted driving, the demand for smart Electronic Component Units (ECUs) will grow for every car, tractors, trucks, buses, and motorcycles that will come out of India’s production unit. Smart semiconductor products have started to change the automotive industry for good.

    Picture By Chetan Arvind Patil

    With the growing demand for automotive vehicles in India and the ability to export it in different regions, isn’t it time to ensure that the semiconductor products that are drivers of smart capabilities are also manufactured in India?

    The fairly old and well established automotive industry can surely enable semiconductor manufacturing growth given the increasing demand for smart solutions from infotainment to radar to collision avoidance.

    It is being anticipated that in 2030, 80% of the cars driving capability will be based on smart ECUs. Rest 20% will depend on the rules and regulation around level 5 is autonomy.

    AUTOMOTIVE INDUSTRY IN INDIA

    India has set an ambitious goal to move to alternate-fuels for automotive. First step is 100% electric cars only by 2030. This also means increased demand for semiconductor products that make up the smart ECUs to enable efficient driving.

    With each new car having more feature than the last one and all of these features relying on semiconductor solutions, raises the question of how automotive industry can drive semiconductor manufacturing in India.

    A very crucial and vital role will be played by the Original Equipment Manufacturers (OEMs). India is already home to all of the top automobile manufacturers that are evenly spread across different clusters and states.

    India Will Be The World’s Third-Largest Automobile Manufacturer With A Market Size of $300 Billion By 2026.

    Picture By Chetan Arvind Patil

    Designing of automotive ECUs is actively done in many of the R&D offices by the semiconductor companies in India. However, the majority of these smart solutions are manufactured overseas and then imported by automotive customers back in India.

    If all the activities from design to manufacturing of semiconductor products for the auto industry is done in house in India, then the benefits in terms of employment and business are huge.

    Any advanced car that is manufactured in 2020, has around 100 million lines of software code that has to meet automotive regulation. The established software industry in India can then provide over the top (OTT) solutions that will quadruple the amount of safety features on top of the smart mobility solution provided by the semiconductor solutions.

    LEADERS IN SEMICONDUCTOR AUTOMOTIVE SOLUTIONS

    Currently, the leaders in semiconductor manufacturing for the auto industry are all based in the Americas, EU, or East Asia. India certainly is home to all these semiconductor giants but only from designing and R&D point of view, which in itself is a great advantage.

    The automobile industry’s growing demand for smart semiconductor solutions in India should be an attractive opportunity. Establishing semiconductor manufacturing units in India not only allows semiconductor design companies to have access to the automobile industry but can also enable the growth of other sectors that they are catering to apart from the auto industry in India.

    Having an end-to-end design to manufacturing solutions in India will also help companies innovate faster and enable cost savings without compromising on security and quality.

    Another important factor is India’s open market that already has a talent pool to drive innovation. Many companies already heavily invested in R&D activities that can then quickly be tested using the automotive infrastructure.

    SEMICONDUCTOR AUTOMOTIVE OPPORTUNITIES

    As per Deloitte, the cost contribution of automotive electronics in 2007 was 20% and in 2017 it increases to 40%, and by 2030 it is expected to be 50%. With the way smart mobility is changing the auto industry, it is fair to say that the trend is only going to go up. Alternate fuel will demand more smart semiconductor solutions and many of these are already in use.

    From infotainment to lane assistance, all require ECUs that are not manufactured from start to end in India. This has lead to an increase in the cost of semiconductor components.

    Picture By Chetan Arvind Patil

    With the increasing use of electronics in automobiles along with exploding automobile industry, India needs to re-think the policies such that they not only cater to the automotive industry but also enable semiconductor manufacturing.

    Having policies that provide more financial and profits based incentives is going to attract foreign direct investment in semiconductor manufacturing much faster than a scheme that only caters to one domain that needs to be started from scratch in India.

    AUTOMOTIVE AND SEMICONDUCTOR MANUFACTURING COLLABORATION

    India cannot afford to be 100% importer of these electronic semiconductor solutions if it has to be the leader in the automobile industry in the smart mobility world.

    The automotive industry in most cases doesn’t require the lowest semiconductor technology node possible. That can be one take away where semiconductor fabrication can be set up for higher technology nodes, which are cost-effective and affordable given India’s history with semiconductor manufacturing. Apart from automobiles, higher technology node can also cater to other segments like smart devices, smartphones, and smart infrastructures.

    Picture By Chetan Arvind Patil

    There are already many greenfield electronics manufacturing clusters that are in the region where automotive companies already have manufacturing units. Collaboration between the automotive and semiconductor industry in India needs to be explored to drive semiconductor automotive manufacturing.

    Automotive Electronics Account For 8% of Electronic In India

    The sensor market for automotive itself is going to be worth $5 billion by 2022. This is just one of the many segments that automotive in semiconductor solutions for. Adding AI to semiconductor solutions for smart mobility is going to increase the market demand tenfold. Having all such solutions in the house is critical for long term financial and innovation growth.

    Picture By Chetan Arvind Patil

    Designing of advanced automotive semiconductor chips already happens in India. The only hurdle is manufacturing and testing at large scale. The government of India is already looking to expand the local manufacturing of automobile equipment and it is about time to enable the same for semiconductor manufacturing from automobile use.

    The success of automobile semiconductor manufacturing in India will surely enable the growth of end-to-end semiconductor manufacturing for different domains.

    PSA

    NXP is a leader in advance autonomous semiconductor solutions from design to manufacturing and below videos show a glimpse of how they do it.

  • The Smart

    The Smart

    Photo by Rahul Chakraborty on Unsplash

    THE SMART

    As technology is progressing, the world is becoming smarter. The decision making is becoming more data-driven rather than experience-driven. People around the globe rely more on smart systems to find solutions to their daily problems. With the proliferation of Artificial Intelligence and its influence on day to day life, the world is only going to become more reliant on smart services and products.

    The smart software and hardware systems have already found its way into every consumer product. Cars are becoming more connected. Homes are becoming more energy-efficient due to data-driven decisions. Logistics and transportation are data-enabled too. All this has enabled companies to spend wisely, while being profitable at the same time.

    The next decade is going to see the wider adoption of smart devices. The impact of these devices is going to enable a smarter ecosystem. Software companies are also launching smart hardware, which is also helping in the growth of the smart ecosystem market.

    There are certain key areas where smart technology is going to enjoy an exponential growth.

    THE SMART KEY AREAS

    Major areas where the smart technology is going to be more profitable are:

    • Smart Data
    • Smart Environment
    • Smart Manufacturing
    • Smart Transportation

    Smart Data: The systems that are being deployed across the cities, offices, houses, industrial areas, etc., are by default being designed to monitor the surroundings. The major goal of these systems is to capture the data in the cleanest form possible. The subsequent system doesn’t have to post-process the data and this ensures that the decision is provided in the shortest possible time. The data collection, processing, and the presentation are going to be the critical piece in order to classify a system as smart data ready. Smart data has already seen tremendous growth in the last decade and promises to be on the same path.

    Smart Environment: In the last decade, as technology innovation has progressed, so has the use and deployment of it. The turnkey infrastructure projects have embraced the new possibilities that smart solutions are capable of providing. The buildings are becoming more sensor-driven. The cities are becoming more connected. The open spaces are more secure due to smart security cameras. The schools and offices are more eco-friendly. All this is becoming possible due to the efficient use of spaces that are being created with the usage of the smart systems, which can project and provide an optimized solution against the capital expenditure. The net-zero concept is the main driver in enabling the smart environments around the cities and countries. With new infrastructure projects, the smart environment domain is only going to enable the growth and adoption of the smarter technologies.

    Picture By Chetan Arvind Patil

    Smart Manufacturing: Manufacturing is hard. The time and effort required to build a product involves a lot of steps and resources. Any company that is into manufacturing has one major goal: eliminate waste. The waste can be at any stage from the procurement to development to delivery. Money saved in manufacturing without compromising the quality is money earned. Companies are relying more on the robotic decision (while balancing human resources) to optimize the manufacturing process. Smart manufacturing is also relying on artificial data decisions to make a more profound judgment based on the market need, in order to manufacture the products efficiently. Industry 4.0 is here, but in a few years time, the world will move to Industry 5.0, which will rely more on smart manufacturing. As the factories start to invest in smart manufacturing to reduce waste, the opportunities for the smart solution providers will also grow. It has already started happening in automobile and semiconductor manufacturing.

    Smart Transportation: It is human nature to move from one place to another in the search of better opportunities. Uber and Lyft have already provided a sneak peek on how future transportation is going to be. With Waymo expanding the driverless riding services, more driverless cars will inevitably be seen around. This points out how the world is going to adopt smart transportation that is connected and statistically geared to be safer than human-driven cars. The logistics domain is also going to adopt to these smart technologies to save on the cost and become more profitable. As more companies and startups put in talent to make vehicles ecosystems smarter, the opportunities in this area will also keep growing.

    These are the four key areas, where the smart ecosystem is enjoying (and will keeping doing so) faster adoption and positive growth.

    THE SMART FUTURE

    The smart solution heavily relies on both the smart software and smart hardware.

    Smart software: In the last decade, software has become more advanced that ever. The machine learning, deep learning, and artificial intelligence solution created on top of the vast amount of data collected due to internet adoption, have ensured that the systems can understand the need before it is needed. As more people come on board the online world, the growth and usage of the smart software is also going to increase.

    Smart Hardware: Hardware development has kept the pace with the software, however, the hardware innovation has always relied on massive systems that are power-hungry. The supercomputers are capable of providing solutions in seconds, but that comes at a steep cost. Slowly, the hardware is also getting embedded with artificial intelligence, at the architecture design stage, to make it more adaptive and thus ensuring smart solution at low cost. The possibility of performing massive computation at source is going to make the computer systems more smarter and faster than ever.

    It will be interesting to see how the growth in the smart software and the smart hardware solutions in the next decade is going to shape the smart world.

  • The HaaS

    The HaaS

    Photo by Taylor Vick on Unsplash

    The software business delivery model has been constantly changing. It has adapted the need of the market by leveraging all the possible ways to deliver the software solution hassle-free. From installing software using a CD-ROM or USB Flash Drive to installing over the internet, the ease of accessing and using software has changed a lot.

    The customers have also adapted to the changing landscape. From worrying about configuring the license key correctly to transitioning to subscription (monthly/yearly) model has provided numerous benefits.

    One major change in the software delivery model has been the cloud services, which has pushed the applications from the desktop to the browsers. This has greatly eliminated the need to configure the operating system and environment settings required to ensure that the application works flawlessly. Today, with the click of a button, one can securely log on to the website and access the software tools using any browser without worrying about the underlying operating system.

    While the software has certainly made great progress, hardware has not been behind. The sole reason one can access software tools remotely is that the data centers located in the different parts of the world are working in harmony. This is to ensure that all the requests are processed with zero downtime and minimal delay. The underlying network of hardware ensures that, low latency is not a hindrance in accessing the software features. This has removed the need to maintain self-hosted servers and has allowed customers to instead invest in other critical solution to make the day to day task more productive.

    The software licensing and delivery model today is termed as Software-As-A-Service (SaaS). It is a subscription-driven model where the application is hosted on a server and can be simultaneously accessed by all the subscribers without any resource constraints. The server will have all the software dependency pre-configured to let the developers focus on the delivery.

    To run the SaaS model, a set of hardware tools are required. Instead of spending millions of dollars on the hardware infrastructure and maintenance, many enterprises and solution seekers have moved to the hardware licensing and delivery model and it is termed as Hardware-As-A-Service (HaaS).

    The major difference between SaaS and HaaS, is the application. SaaS is primary all about software, while HaaS is not just about computer hardware and system but also about all those smart hardware solutions that are running the SaaS.

    THE HaaS APPLICATIONS

    The application areas of any given product is what differentiates it from competitors. In the last decade, the HaaS application has increased and many smart hardware providers have moved to the product-based service model.

    The important application area of HaaS has been the data center, where cloud service providers (Amazon, Google, Microsoft, etc.) and content delivery networks (Akamai, Cloudflare, etc.) have created plethora resources to cater the growing need and demand of software enterprises. Anyone can rent as many nodes required and deploy a solution. The shared and dedicated website hosting also falls into the same category. Renting out per month basis than buying the hardware and setting up in the office is more cheaper and reliable. HaaS (Hardware == Data Center) also eliminates the cost of setting up a dedicated team to handle all the data center related issues.

    The growth of smart devices has lead to change in the way consumers consume these products. Taking the queue from the smartphone business, it is evident that a new version of the smartphone is launched every year. This automatically prompts consumers to buy a new one due to the attractive features. Shelling out more than $500 every year on a smartphone is not what every consumer would like to do. To tackle this issue, the service providers (mainly cellular one) moved to the HaaS model (Hardware == Smart Device), in which they started providing the smartphone as part of a monthly plan than paying upfront. It certainly has pros and cons, but has provided consumers the ability to switch to better devices as and when required. This smartphone subscription model is now being extended to several other smart devices like cameras, drones, watches, security, T.V., and the list is endless.

    Picture By Chetan Arvind Patil

    Mobility is a very crucial part of the day to day life. In the transportation area, the HaaS model (Hardware == Vehicle) has been in use for decades. The model of renting the vehicle for a specific period is well proven and widely used. Due to the proliferation of vehicles for hire services, the HaaS model is being applied more relentlessly. From car to skateboard to electric bike to bicycle, now everything is available under the HaaS model. The growth of point-to-point will keep extending the application area of the HaaS within the mobility domain. Gen-Z and Gen-Alpha are going to mostly rent the vehicles under the HaaS model than spending money to purchase one.

    As countries around the world move towards 5G and Wi-Fi 6, the digital landscape will also change as more consumers will have the ability to connect to the online world. This will demand a vast array of the internet of things that needs to be deployed across cities, states, and countries. The business (internet service providers) will unlikely follow the trend of settings technology on their own. This is where the HaaS (Hardware == Internet of Things) model will come in as a way to save cost while providing services.

    Apart from the discussed application areas above, there are still miscellaneous domains where the HaaS model can be applied. It is already in use in the airline industry, where purchasing air crafts has moved to a year-long rental agreement. A similar concept will start to fill in the developing world where services are more vital now than ever.

    THE HaaS BENEFITS

    Technology when applied correctly, provides numerous benefits. SaaS showed many benefits to the software world. Same applies to the hardware world due to the HaaS implementation.

    Cost is one of the major benefits of HaaS. The ability to rent out as many nodes for as many days required has provided new way for consumers to manage the cost. In many cases, consumers can spend money wisely in other critical areas. The ability to terminate and forget about the infrastructure is also one keys to why the HaaS model is getting popular.

    The HaaS provides a way to access services anywhere. From data centers to mobility all are available at the click of the button. The HaaS will be deployed and available at the doorsteps. Majority of the cities around the world are already equipped with several HaaS services and this has provided reliable uptime to the services.

    Picture By Chetan Arvind Patil

    Portability is another important benefit of HaaS. The option to switch smart devices to a new one without worrying about the cost is one example. Even with data centers, one can move from one cloud HaaS provide to another, without the need to understand the underlying process and technical challenges.

    With SaaS, the quality and reliability of software services improved. Always on services and customer support was a great addition to the SaaS model and it has ensured that the customers are never out of help. The same quality and reliability solutions have been extended to the HaaS model and are taking the customer experience to a new level.

    Digital transformation, expanding high-speed network, and advancement in the semiconductor solution is only going to improve the HaaS experience.

    THE HaaS FUTURE

    Given the expansion of the artificial intelligence and autonomous solutions, it is highly unlikely that the HaaS delivery model will change much from the existing one.

    The HaaS in the future will keep evolving around the following three important aspects:

    • Users
    • Middleware
    • Services
    Picture By Chetan Arvind Patil

    Users are the consumers for the HaaS model and paying for the service. Middleware is the connectors between the users and service providers and gets the share of both sides of businesses. Services are the different solution providers with innovative services and products.

    It will be interesting to see if the industry moves to a new way of subscribing to the services. Currently, the business is moving around pay as a use model, and it has worked wonders both for the service providers and the consumers. However, every model evolves, and with the rate at which the technology is advancing, it will be important to adapt the business model accordingly. What new way of supporting these services will come, only time will show.