Amit Sinha

Very good interview with Avijit Sinha, President of Wind River and Amazon Web Services (AWS) at their #reinvent event, on the importance of #edgeAI and their investment in this area - including a nice shout out for EDGE AI FOUNDATION …! Bill Podrasky Efren Mercado Michael Kuptz Rosina Haberl Evgeni Gousev Walter Sullivan Sandeep Modhvadia

19

JFrog reported its quarterly earnings on Aug 7th. ProntoNLP compared the JFrog earning call transcript to 3 other similar SAAS (DevOps) companies as well as to the average of the software GICS group. ProntoNLP's Aspect based LLM signal gave an early warning for JFrog on May 9th 2024 (their last earning call) when the Aspects score dropped from 0.52 to 0.4. ProntoNLP analyzed the earning call transcripts of these 4 SAAS (DevOps) companies JFrog, Atlassian, Dynatrace and Datadog. As can be seen in the image below the only company that had an increase in the LLM score compared with its score last quarter is Atlassian while JFrog had a much lower LLM score (-16%) compared with their last quarter (Color Legend is at the top part of the image below). The dotted navy blue line shows the average LLM score for each of the last 4 quarters for the whole software GICS group. All these 4 companies are SAAS companies and hence the customer related LLM categories are extremely important. The image below shows that Datadog and Atlassian have extremely high values for Customer Acquisition, Customer Behavior and Customer Retention. ProntoNLP's new LLM Aspects based signal for these companies shows the following trend: JFrog: a huge decline from 0.4 last quarter to 0.08 Atlassian: score stayed the same at 0.43 Dynatrace: slight decline from 0.45 last quarter to 0.42 Datadog : slight decline from 0.47 last quarter to 0.42 Based on the LLM scores in the Customer related categories and the change in the Aspects scores of the 4 software stocks it seems that Atlassian and Datadog are the top picks now and JFrog is at the bottom of the pack. The new comparison feature of ProntoNLP is extremely powerful and can support picking the winners and losers within any GICS group based on the latest #GenerativeAI technologies. ProntoNLP provides via SFTP real time quantitative signals on earning calls, filings, macro and news. Reach out to ProntoNLP to start using our #GenerativeAI based tools and Maintain an edge in alpha creation. #Quant #HedgeFunds #ArtificialIntelligence #StockMarket

7

We are excited to back Morphing Machines. As Dr. Ranjani, CTO and co-founder says: “For the first time in India and globally, we have a processor that is truly runtime reconfigurable, catering to emerging workloads.” While Nvidia’s growth and high valuation are driven by robust demand for “infra-compute” in high-performance GPUs, spurred by Gen AI, there is a distinct need for innovative solutions tailored to a new wave of reactive applications. Enter Morphing Machines. It addresses this demand with its unique product designed for next-gen telecom, autonomous vehicles, collaborative robots, avionics, and online data analytics. This product is specifically engineered to handle heterogeneous workloads and diverse tasks with varying performance demands simultaneously, ensuring a high level of scalability. As we move from an institutionally-backed research team at IISC to productization, Golden Sparrow is collaborating with Speciale Invest and others to support Deepak Shapeti, who joined as CEO three years ago after earning his Masters at Stanford. He brings not only technical expertise but also the business acumen necessary to guide the product to commercial success. Venkat Raju Afreed Faizan Anand Rao Ritik Singh Michael Marmor

68

5 Comments

No Vendor lockins, No Proprietary Stuff, Freedom in using the Cloud, Data Sovereignity is the way to go! And of course lower TCO and better quality of service. Computing should be a utility, simple and easy to use, not just for techies. This is what we are set out to do at People+ai #OpenCloudCompute #OCC

19

2 Comments

The 7th workshop on Neural Scaling Laws is about to start: https://lnkd.in/gQSB5k8v Scaling laws, emergency, alignment, transfer learning, with a focused track on multilingual models. Looking forward to kick it off with Irina Rish and discuss all these topics with Yuhai Tu, Paul Bogdan, Hailey Schoelkopf, Darshil Doshi, Rio Yokota, Neha Sengupta, Preslav Nakov, Tatiana Shavrina, PhD, Yishi Xu. Join in person or virtually! #icml2024 #ai

37

Pranay Prateek from SigNoz shares his thoughts on Unified Observability and how Open Source Signoz can help you to harness OpenTelemetry (OTEL) for Traces, Metrics at Logs. This talk took place at Open Source Observability Day #opensource #observability #otel

25

1 Comment

See our GPUaaS software demo

19

💡 Compute is the new oil in this AI era. Cedana solves this providing a solution for saving, migrating, and resuming compute jobs across cloud vendors without interruptions or code modifications. Essentially it helps companies leverage "compute arbitrage" 🤯 Here's their CTO Niranjan Ravichandra talking about how they use SigNoz to monitor the behavior and performance of daemons across customer nodes. Our powerful APIs and ability to write advanced ClickHouse query enables them to pull data into Jupyter notebooks & analyze performance trends across hundreds of nodes. Excited to see SigNoz powering observability of cutting edge companies like Cedana 🚀 https://lnkd.in/gzZtMwdN

36

Latency is important in #WebRTC communication With LLMs, Generative AI and Agentic AI? It is even more important As an industry, we need to figure out how to shave more milliseconds in our processing pipeline Why? Because the LLM piece, along with STT and TTS take TIME⏳ Time we don’t necessarily have This is going to be a big part of my upcoming workshop on #GenAI & WebRTC Register now to reserve your spot! Link in comment

1

1 Comment

Thanks People+ai! Check out the video below to know what I am up to these days! I am building hardware to make AI accessible to all!

59

5 Comments

Ai : Hunanity's greatest creation for Good and Bad. To secure ourself #zerotrustai In the journey, MS brings up VASA-1 will AI model which essentially spins a selfie image and turn it into a talking clip of you. All you have to do is upload a photo along with a voice note and let the AI model do the talking for you.

2

LinkedIn Post: PAI Morning Briefing – December 13, 2024 🌟 Good morning, professionals and market enthusiasts! 📈 Welcome to the PAI Morning Briefing, brought to you by PantheonAI. I’m your host, here to guide you through today’s market movements, key trends, and strategic insights. Let’s dive in! 🚀 📊 Market Overview • S&P 500: Slight dip, closing at 6,051.25 (-0.37%) • Dow Jones: Down to 43,914 (-0.57%) • Nasdaq: Showing resilience at 19,902 (-0.22%) • Russell 2000: Sharper drop to 2,361 (-1.10%) 💰 Cryptos: • Bitcoin: 📈 Slight gain to $100,236 (+0.20%) • Ethereum: 🚀 Strong growth at $3,926 (+1.12%) 🔍 Market Trends and Headlines 🔥 Broadcom Eyes $1 Trillion Market Cap AI chip sales are propelling Broadcom closer to joining the trillion-dollar club. With artificial intelligence transforming industries, Broadcom’s bullish forecast could set a benchmark for tech giants. 📈 Bond Market Yields Rise After four consecutive days of increases, bond yields are reflecting the Federal Reserve’s challenges in combating inflation. Investors are navigating the nuanced implications of monetary policy shifts. 🎅 ‘Santa Rally’ Incoming? U.S. equity markets have seen record inflows of $186B over nine weeks, pushing market heights to $11.77T. Goldman Sachs hints at a potential rally to close out 2024 on a high note. 💡 Expert Insights With inflationary pressures and shifting policies, navigating the current market environment requires vigilance and strategy. Key areas to watch include: 1️⃣ Tech Innovations: Companies like Broadcom are driving transformative growth. 2️⃣ Energy Dynamics: Ongoing transitions and acquisitions are reshaping the landscape. 3️⃣ Policy Shifts: Regulatory changes in banking, healthcare, and infrastructure are pivotal. Thank you for tuning into the PAI Morning Briefing! Stay informed, stay ahead, and have a fantastic day of investing! 🌟 #Finance #Investing #Markets #Crypto #Broadcom #AI #Energy #EquityAI #PantheonAI #StockMarket https://lnkd.in/eKaUWgHH

5

Challenges of AI Networking for hyperscalers and enterprises Sept 27, 2024 I had the opportunity to meet with Manohar Paluri, VP of AI at Meta, this evening at the AI Tech Leaders Club, just under 24 hours before the AI Infra Summit on September 27, 2024. It’s been confirmed that the large training cluster at 500K GPUs is the next frontier for the hyperscaler industry. Meanwhile, on the enterprise side, standalone cluster sizes typically range from 20K to much smaller setups for retraining and inference. From my experience, while the challenges in these two sectors are intertwined, they can still be stated separately. 1) Checkpointing Challenges: Large GPU clusters require numerous checkpoints to maintain system reliability. The industry has recently implemented networking and checkpointing solutions for clusters with around 20K GPUs. Imagine the challenges we’ll face at the scale of 500K GPUs! 2) GPU Utilization: Typical GPU utilization hovers around 20%. While hyperscalers may achieve better numbers, overall utilization remains low. For this, a startup came up a clever solution to power down the idle GPUs dynamically to save up to 60% of power consumption from a GPU cluster. This approach could either reduce power usage from idle GPUs or, in conjunction with increased GPU utilization through further resources sharing—like memory, network, and model partitioning/parallelization—enhance overall efficiency. 3) Deployment Flexibility: The deployment of data center networks (hyperscaler cloud) or private networks (on-premises) for enterprises often lacks the necessary flexibility. For more insight, I recommend reading the justification for Google’s Optical Circuit Switching (OCS) network. Following conventional practices without innovative solutions can lead to over-investment in AI and cloud infrastructure. 4) ROI Optimization: Classic cloud infrastructure is often not optimized for ROI in AI networking, which leads to operational challenges for enterprises. To understand this, a little involved discussion is needed. Once understood, it becomes part of your instinct. Consider the competitive disadvantage faced by businesses that optimize ROI in their AI networks. Free Takeaway from me: Conversations about the challenges of AI infrastructure and networking are very welcome at the AI Infra Summit, and participants will receive the latest AI networking problem slide! 😊

11

5 Comments

With over 20 years of experience building accelerated computing solutions across domains, such as security, data movement, and data storage, DataPelago CEO and Co-Founder Rajan Goyal has assembled a world-class team with decades of expertise across system, architecture, data analytics, cloud SaaS, open source development, and more to rethink data processing in today's AI-driven world. Today, the company came out of stealth with $47M in funding and introduced the first universal data processing engine and ultimately, is creating a new data processing standard for the accelerated computing era to overcome performance, cost, and scalability limitations. By enabling data to be extracted as quickly as it's generated, businesses will have the ability to harness insights to make better decisions and operate more efficiently, unlocking new possibilities in critical industries like supply chain, healthcare, energy, and more. https://bit.ly/4gG5hIy   Congratulations Rajan Goyal and DataPelago team!

104

BREAKTHROUGH for companies concerned about privacy. Article excerpts: Called a “secure AI manager” application... Generate relies on the PC’s processor... including its neural processing unit (NPU), and local memory... to run retrieval-augmented generation (RAG), vector databases and large language models for a variety of generative AI use cases that are meant to improve productivity. For instance, Generate can “consume extremely large documents” with more than 300 pages and use RAG methods to produce summaries and document comparisons for business analysis or training purposes, according to Iterate.ai. It can also be used by call centers to “analyze inbound messages, prepare summaries and call up any relevant customer records and corporate policies.” Kevin J. Homer said the fact that all of this is processed locally rather than in the cloud is a major differentiator for Generate over other solutions. Iterate.ai is hoping this will win over businesses that have been hesitant to use AI solutions that send private data to the cloud. “I think everybody’s concerned about the bi-directional nature of these chatbots,” he said. https://lnkd.in/eTwDEXZM #AI #AIPC Peter Cobb Magnus Tagtstrom Michelle Pacynski Mike Edwards Agustina Sartori Ashish Shah Dan Murray Sapna Shah Scott Weavers-Wright OBE Fred Soneya Gary Gaessler Brittany Morris Saunders Sandra Hagen Solin

38

6 Comments

JFrog Ltd., the Liquid Software company and creators of the JFrog Software Supply Chain Platform, today announced a new product integration with NVIDIA NIM microservices, a component of the NVIDIA AI Enterprise software platform. Their platform has been expanded to include a unified MLOps platform as a result of the acquisition of Qwak AI. It is anticipated that the JFrog Platform will be integrated with the JFrog Artifactory model registry and NVIDIA NIM to create an end-to-end software supply chain workflow that combines GPU-optimized, pre-approved AI models with centralized DevSecOps processes. Read more - https://lnkd.in/gpy_sCJZ For Startup funding reach out us at: https://lnkd.in/gra5x2Xi To share your startup information write us on - startup@viestories.com Join Our Whatsapp Channel To Get The Latest Updates & News: https://lnkd.in/esJEFzan #tech #AI #automation #nvidia #JFrog #AIEnterprise #microservices

1

Good story by Karan Kamble about how the Tanvi Lall led OCC could be India's answer to the market dominance of Azure, AWS and GC types. Could be an UPI moment for cloud computing in India! https://lnkd.in/gbFBAyJj

8

Perspectives on cortex fine-tuning from Baris Gultekin of Snowflake. Increased accuracy and reduces cost of the models enables viable business models for AI-first companies. We feel lucky to have Baris Gultekin as our angel investor.

8