Vinoth Chandar

Recently Haytham Abuelfutuh presented about Batch Workloads and how Union and Flyte are used for Large scale batch and near realtime workloads. Check out this post to 1. Learn about the challenges in using Kubernetes for running Batch workloads 2. The problems in the programming model with Batch workloads. Often times its not a single job - but it may start with one 3. The simplification that can be introduced by using Union. Union runs them across multiple clouds, multiple kubernetes clusters, securely accessing large amounts of data, while maintaining efficiency through - caching, smart techniques in which container state is saved, how pods are used, how back pressure is maintained etc. Check out the blog.

9

Worth reading: How the Apache Arrow Format Accelerates Query Result Transfer by Ian Cook One of the hidden problems of intersystem communication is transcription of data formats. Ian does a wonderful job of explaining the "why" of Apache Arrow as well as the "how" of its advantages. Read on...

8

🚀 Want to run your very own trained LLM, privately and securely? 🤖🔒 Imagine harnessing the power of a Language Model tailored just for you without worrying about third-party servers! 💼✨ Try, LM Studio. Jest for few click . LLM running in your PC. With LM Studio, you can ... 🤖 • Run LLMs on your laptop, entirely offline 📚 • Chat with your local documents (new in 0.3) 👾 • Use models through the in-app Chat UI or an OpenAI compatible local server 📂 • Download any compatible model files from Hugging Face 🤗 repositories 🔭 • Discover new & noteworthy LLMs right inside the app's Discover page #LLM #private #chatgpt #AI

9

#Observability sold as SaaS is just 1% of its potential. Here’s why your org is paying full but losing out the remaining 99%: Observability also has four very distinct components: ↳ Generation : Creation of telemetry data using instrumentation in user space or kernel space. ↳ Pipeline: Collecting, processing, and exporting telemetry data to storage. ↳ Storage: Storing the telemetry data efficiently, allowing real-time access and availability. ↳ Visualization: Presenting data in a simple and actionable manner. If we do not decouple these, you can imagine the hindrance in the development of the observability landscape. There are some really useful products, but they are using (or abusing?) this very fact that it is not decoupled yet, thus harder to replace. Ensuring that these components have their own parallel growth provides each institution the means to build observability which bends to their infrastructure not another way around. And that’s our vision at Incerto. Curious to learn more? Here’s a no BS blog on building the perfect observability solution: https://lnkd.in/g2be3JRw #DevOps #monitoring #developercommunity

15

Observability at the infrastructure and application levels must be harnessed to deal with today’s demanding workloads in #GenAI. Come talk to us to see how you can use the new AI with observability data to optimize your services.

17

➰ APIContext's latest insights on cloud-based API performance have been featured on Nordic APIs! In the 2024 report, we delve into crucial aspects affecting API efficiency: 🔐 Authentication is key. Ensuring robust authentication mechanisms in APIs is crucial, yet offloading this function can introduce complex challenges. 📖 DNS configurations matter. How you handle DNS settings can significantly impact API performance, particularly when tied to authentication processes. 🌐 The role of third parties. Critical third-party services play a significant role in 🔗 API transactions, underscoring the need for careful integration and monitoring. ⛅ Not all clouds are created equal. Differences in cloud services can drastically affect API performance, an essential consideration as APIs account for over 80% of all internet traffic. #APIs #CloudComputing #TechInsights #APIContext

15

1 Comment

For CKA Exam aspirants, There’s some good news and some bad news. The bad news is, The CKA exam is updating after November 25, 2024. New topics will be added, focusing more on real-world Kubernetes skills like the Gateway API, Helm, Kustomize, CRDs, and Operators. The good news is, These updates are great for those who want to truly master Kubernetes and become real-world CKA experts. I’ve written a blog comparing the old and new syllabus and outlining the additions. 𝗖𝗞𝗔 𝗨𝗽𝗱𝗮𝘁𝗲 𝗕𝗹𝗼𝗴: https://lnkd.in/gsqUc5TG 𝗡𝗼𝘁𝗲: Any CKA exam taken after the updated release will test on the new set of Domains and Competencies I personally wanted the syllabus to change because Kubernetes administration has evolved a lot in the real world. These updates will help engineers with the concepts needed for real-world setups. ♻️ PS: Dont forget to Repost and share this news with the community. #DevOps #Kubernetes #CKA

681

22 Comments

My talk in the CMU Database Building Block series is up! Building #InfluxDB 3.0 with the FDAP Stack: https://lnkd.in/ez5fpVTN There's some intro material that's probably familiar to many, but then I get into specifics on how we're using Apache Arrow, DataFusion, and Parquet to build InfluxDB 3.0. I also talk about the new single server architecture we're building for the upcoming open source release. Throughout I give some thoughts about the evolution of the database and what motivated the big rewrite in #rustlang.

45

4 Comments

AWS Sagemaker is 40% more expensive than EC2 instances with suboptimal developer experience and technical limitations. Here's a blog comparing TensorFuse (YC W24) as a Sagemaker alternative. https://lnkd.in/gewcPNU2

21

2 Comments

🚨 Anthropic Drops Major Updates: New Claude Models & Computer Use API! 🔄 Two New Models Released: 1️⃣ Upgraded Claude 3.5 Sonnet - Available now on Anthropic, Google Cloud Vertex & Amazon Bedrock - Outperforms previous version on most benchmarks - Significant improvement in coding (SWE bench: 33.4% → 49%) - Better at agentic tasks & tool use 2️⃣ Claude 3.5 Haiku (Coming Later This Month) - Initially text-only (vision support coming later) - Surpasses original Claude 3 Opus on some tasks - Faster & more cost-effective option - Exceptional performance for its size 🖥️ New Computer Use API: - Direct computer interaction capabilities - Can perform web searches, edit documents & navigate interfaces - Uses basic commands (mouse movements, clicks, typing) - Similar to autopilot technology - requires supervision - Currently focused on web-based applications ⚠️ Safety Considerations: - Need for careful implementation - Potential for errors (as seen in testing) - Recommendation: Use on separate dedicated machine - API documentation and safety protocols pending 💡 What's Next? - Claude 3.5 Opus still anticipated - Further development of computer interaction capabilities - Expanded vision support for Haiku This release marks a significant step forward in AI capabilities, especially for coding and automation tasks! 🚀 #AI #Anthropic #Claude #ComputerUse #Innovation #AITechnology https://lnkd.in/edUXq6Rv

49

3 Comments

This week, I've gotten interested in testing how well multimodal modals handle document text extraction. The results are rather surprising... surprisingly good. 🤯 I've completed some testing with Anthropic Claude 3.5 Sonnet to see how it compares to cloud services like Azure AI Document Intelligence. You can read the details in a new blog post, which shows the structured JSON output returns from a simple prompt against an document page screenshot. Since these models have now become a reliable alternative, we will add support for them in the Graphlit, by Unstruk Data preparation workflow. https://lnkd.in/gpzFVwFy #unstructureddata #pdfextraction #multimodal #llm

14

𝐀𝐦𝐚𝐳𝐨𝐧 𝐃𝐲𝐧𝐚𝐦𝐨𝐃𝐁 𝐢𝐧𝐭𝐫𝐨𝐝𝐮𝐜𝐞𝐬 𝐜𝐨𝐧𝐟𝐢𝐠𝐮𝐫𝐚𝐛𝐥𝐞 𝐦𝐚𝐱𝐢𝐦𝐮𝐦 𝐭𝐡𝐫𝐨𝐮𝐠𝐡𝐩𝐮𝐭 𝐟𝐨𝐫 𝐎𝐧-𝐝𝐞𝐦𝐚𝐧𝐝 𝐭𝐚𝐛𝐥𝐞𝐬 It's going to be super helpful in cost control. Will help in accidental surge in consumed resources and safe guarding downstream services with fixed capacities. https://lnkd.in/gWmAjXv3

16

🇮🇳 How does Skyflow help drive DPDP compliance in India 🇮🇳? 🇮🇳 How does Skyflow protect data in LLMs? 🇮🇳 And in Snowflake ❄️? And Databricks 🧱? 🇮🇳 Check out our story in India’s leading tech publication YourStory Journal 🇮🇳 Link in comments.

65

2 Comments

For those of you building RAG: next week (May 21) we're hosting a webinar with MongoDB that will help optimize those apps--

14

💙 Excited to share my latest post on TheNewStack on addressing the staging bottleneck problem impacting Engineering teams building Microservices: https://lnkd.in/gM_hB_wC #stagingenvironments #kubernetes #microservices #testingstrategies #developerexperience

8

If you jump into the cloud world with cost as the primary basis, there may be discontent. There are few other value levers that are frequently floated around to assert the benefit of cloud. I have seen posts negating them as well. But in my opinion, the reason organizations need to look at the cloud, now more than ever, is what is getting infused in cloud solutions- Artificial Intelligence (AI). #data #analytics #ai #ml #datascience #designedanalytics https://lnkd.in/g6JjdEN9

Looking to join a cool new AI-for-DevOps/Platform/SRE project? RunWhen Authors Meetup SF - Aug 14th, 5:30-7:30pm. Friends don't let friends troubleshoot alone... If you are interested in submitting AI-ready troubleshooting automation for Istio, Kafka, Postgres, Nginx, Vault, GCP Networking (various), Azure Storage (various), APIM and others, come check it out. We pay royalties and bounties when our enterprise customers use your automation. Sometimes this is developers untangling a shared service, or AI Assistants running to research a failed test. Sometimes it is an automated response to a production alert. The model is simple - automate what you would do next. RSVP with the meet-up link in the notes. I hope to see you there.

22

5 Comments

Nice blog from Ghanshyam Verma for those who are interested to unlock performance improvements in java with virtual threads.

18

1 Comment