Ignacio de Leon ☁

S3 Tables + Iceberg = Ecosystems Matter. I was avoiding making a daily AWS re:Invent post, but after yesterday’s keynote, I can’t resist talking about S3 native support for Iceberg. Last year, I helped a team switch from Hudi to Iceberg, and one big reason was how much Iceberg support had grown since the original choice. It just made sense. This is a reminder that choosing the right architecture isn’t just about tech specs—it’s about the ecosystem and support around it. These things can make or break a project. Some of my old teams are probably grinning right now at the idea of a streamlined S3–Iceberg–Data Lake setup. If you want the official details, here’s the announcement: Amazon S3 Tables with Apache Iceberg. Heads up, though: keep an eye on the costs—they’ll add up fast. And definitely benchmark for your workload; it’s not a typical S3 storage class.

12

1 Comment

Wondering how "Data Intelligence" enhances data governance, data engineering, data streaming, data warehousing and all your data user experiences? See you in Austin at the Databricks Data Intelligence Day this Wednesday August 21st - register here:

13

More goodness to kick off the new year. If you've been wondering about the state or your organizations data quality or got a data quality initiative going in 2025, you should really check out what Anomalo can do for you!

23

1 Comment

During Tableau Pulse's pilot phase, its development team faced a unique challenge: Scale processing from 500 to 20,000 email digests per day while integrating AI/ML capabilities. Explore how they overcame those obstacles to provide real-time, AI-powered insights to customers:

1

An interesting and relevant repost by Ian Coyle Data Ideology, LLC. The competition between Databricks and Snowflake isn't a zero-sum game. Do you agree? #HealthcareData #HealthcareAnalytics #AIinHealthcare #HealthcareInnovation #DigitalHealth #HealthTech #HealthcareTransformation #HealthDataGovernance #ValueBasedCare #DataDrivenHealthcare #PopulationHealth #HealthIT #HealthcareAI #DataScienceInHealthcare #HealthcareQuality #Snowflake #Databricks #Teradata

2

Gain Unprecedented Supply Chain Control with Accenture's Logistics Control Tower on Google Cloud (Powered by project44) Eliminate supply chain disruptions with Accenture's Logistics Control Tower, a centralized hub for real-time visibility and control. Developed in partnership with Google Cloud and project44, this solution: - Reduces costs: Cut expedited shipping and demurrage charges by 3-5%. - Improves lead times: Speed up delivery by 5-10%. - Enhances transparency: Drive collaboration and informed decisions. - Boosts productivity: Optimize processes for greater efficiency. - Heightens agility: Respond to disruptions quickly and effectively. Leveraging the best: - Accenture: Deep industry expertise and proven implementation experience. - Google Cloud: A scalable, data-driven platform for intelligent logistics. - project44: High-quality data and world-leading analytics. Read the blog to learn more and transform your supply chain.

3

Trying to build an AI chatbot, but struggling with performance or concerned about the LLM training on internal data? Join us on April 25th to learn how to deploy AI chatbots within Snowflake! Snowflake AI/ML Architect, Carlos Carrero, will guide you through building a chat application using Retrieval Augmented Generation (RAG) with Snowflake Cortex. Get hands-on experience in: 🛠️ Automating document conversion into semantic vectors 🤖 Building end-to-end RAG apps without complex infrastructure 💬 Developing chat interfaces for rapid deployment of business applications. https://lnkd.in/eVfdsPKj #Snowflake #AI #ML #HandsOnLab #Chatbots

10

Unlock the full potential of your data with #Dataplex in #BigQuery. ✨ Improve data quality, speed up insights, and empower your teams. #Virtusa #googlecloudpartners

2

Lakehouse Analytics through Mission Control on EDB Postgres AI exemplifies our commitment to innovation and excellence in data management and analytics. By harnessing the power of real-time data insights, enriched data environments, and high-availability clusters, we are equipped to meet the demands of modern data and analytics infrastructures and future-proof for new AI workloads. Key benefits of EDB's Mission Control platform: ➡️ 50-90% reduction in query runtimes ➡️ Real-time operational visibility and swift issue response ➡️ Enhanced data integration supporting both analytical and transactional workloads ➡️ Geographically distributed high-availability databases for improved disaster recovery ➡️ Future-proofed infrastructure ready for advanced AI workloads Read the new blog from Dan Merzlyak and Dave Stone to discover how EDB's Mission Control platform is helping our teams achieve unprecedented levels of operational efficiency and customer engagement. Read it here >> https://lnkd.in/eh7Zp585 #Postgres #PostgreSQL #justsolveitwithPostgres #EDBPostgresAI #data #AI #database #DBA #opensource

9

John Snow Labs Named 2024 Databricks Growth Data Partner of the Year We are honored to be named the 2024 Databricks Growth Data Partner of the Year, recognizing our significant contributions and customer success in healthcare AI. Our new state-of-the-art healthcare AI models, now available in the Databricks Marketplace, empower organizations with cutting-edge technology. At the Data + AI Summit, we highlighted best practices and architectures for leveraging these models securely and efficiently. This award underscores our commitment to accelerating progress in healthcare through innovation and collaboration with Databricks. Read more about this exciting news: https://lnkd.in/gXGBuiDh #HealthcareAI #NLP #DataScience #Databricks #JohnSnowLabs #AI #MachineLearning #DataAISummit #Innovation #AIinHealthcare #TechAwards #HealthTech #DigitalHealth #AIModels #HealthcareInnovation

8

We hear a lot about #privacy and #dataownership. We also hear a lot about #personalizedmedicine. Between those two is another domain that is rarely discussed is how well can the individual consumer comprehend their own #data once they get access to it? Part of #shareddecisionmaking is for the patient or end user to have sufficient understanding to engage in an effective conversation with any clinician or entity (like #insurance) who is using those data for care decisions. For that, the patient both needs to have access to data and understand the criteria used for decision making if to share in that decision making for own health. Those data can be from wearables, from "patient reported outcomes", from #EHR, from a variety of sources. Among issues of #literacy there is being able to read, being able to understand numbers (numeracy) and then being able to understand health issues or #healthliteracy. Increasingly, that requires data literacy too. This is a current focus on on how we are considering expanding our #MVP at HER Heard with the help of the team, led on #datascience, this summer, by Andrés Corrada-Emmanuel, who is advising us. "Democratizing" is not only the data being available but the data being understood, personalized in the delivery, and actionable. Access is just the first step. Does the end user have access to analyses and can that end user be empowered, via data, for better #autonomy, choice, and improved health outcomes.

2

Introducing Databricks AI/BI. Intelligent analytics for real world data. "AI/BI marks a significant step towards true self-service BI, substantially expanding the types of analytics everyday users can do through an AI-first approach." #databricks #ai #bi #dataintelligence

10

The big data revolution has made it harder to extract valuable insights. AI and AI-era data platforms are the key to finally unlocking its value.

12

1 Comment

Informatica Expands Partnership with Google Cloud! Informatica launched its Master Data Management (MDM) extension for Google Cloud BigQuery making it easier and faster to get trusted MDM data that can be leveraged for analytics and Generative AI applications across industries. Learn more about how #Informatica is strengthening their global footprint with Google Cloud. #GoogleCloudNext

3

Yet another category to be leading! Forrester named Databricks a Leader in their report on AI Foundation Models for Language in enterprise! Build your own AI on your own private data with Databricks! #llm #genai #ai #ml #data https://lnkd.in/g_QMqqwr

24

2 Comments

Just shared my latest article on CIO Online! I've been diving into how centralized data strategies can cause challenges with responsiveness, alignment and accessibility. Moving towards a distributed data architecture can help, especially with generative AI shaking things up. Curious to hear how others are navigating this shift. https://lnkd.in/gF5vs3j3 #DataStrategy #DistributedData #AI #GenerativeAI #DataArchitecture

40

4 Comments

Proud Tableau has been recognized as a leader in the G2 Spring 2024 reports: 🏆 Business Intelligence 🏆 Data Prep 🏆 Embedded BI 🏆 Predictive Analytics Read why IT leaders choose Tableau for their enterprise analytics →

2