Daniele Stroppa

Amazon RDS for MySQL zero-ETL integration with Amazon Redshift is now generally available With this launch, you can create multiple zero-ETL integrations from a single Amazon RDS database, and you can apply data filtering for each integration to include or exclude specific databases and tables, tailoring replication to your needs. https://lnkd.in/gM_4rPj5 #Amazon #RDS #MySQL

128

Nice to see that the #CohereRerank API is now available on #AmazonBedrock enabling developers to improve the relevance of responses in #RetrievalAugmentedGeneration (#RAG) apps built in Bedrock. The reranker models rank a set of retrieved KnowledgeBase documents based on their relevance to a user's query, helping to prioritize the most relevant content to be passed to the Bedrock foundation models for response generation. For Amazon Bedrock Knowledge Base users, enabling the reranker is through a setting available in Retrieve and RetrieveAndGenerate APIs. The Rerank API supports Amazon Rerank 1.0 and Cohere Rerank 3.5 models. These models are available in US West (Oregon), Canada (Central), Europe (Frankfurt) and Asia Pacific (Tokyo). #AI #EnterpriseAI https://lnkd.in/e7a-eqvr

7

Redshift Serverless just became better with the GA of AI scaling and optimizations.

64

1 Comment

Since we launched DataSharing in Redshift, people really liked the efficient transactionally-consistent access to Redshift Managed Storage across Redshift compute environments, across accounts, even across regions. One of the main requests from the customers was to extend the read-only access to these live datasets, and support writes. Today we are excited to launch the general availability of multi-data warehouse writes in Redshift. #amazon #redshift #datasharing #multiwarehouse #writes #ga

85

2 Comments

Confluent's Field CTO, Kai Waehner, shares insights on the future of streaming analytics and data management, highlighting the importance of reliable data flow, collaboration, and security. Discover how Confluent's cutting-edge platform revolutionizes streaming analytics. Read the full interview: https://lnkd.in/gSMVCmvy #StreamingAnalytics #DataManagement #FutureOfData #BusinessIntelligence

80

This is incredible news for Amazon Kinesis Data Streams On-Demand users! KDS On-Demand now allows writing up to 10 GB/s, a significant 5x enhancement! The most remarkable aspect is that there is no action required to leverage this feature. #Kinesis #data #BigData #streamingdata #Datastreaming #ondemand #AWS Link: https://lnkd.in/gdm_FXrU

47

2 Comments

Enabling use cases like factory floor optimization, assisted workforce, and asset tracking can be expensive and time consuming. Building, deploying, and maintaining configuration can add to the complexity. In this webinar, you will learn from the experts at Google Cloud and ClearObject how to leverage the very latest in AI, modern infrastructure, and edge computing to enable modern manufacturing outcomes in your center today.

1

Well done #AWS for promptly fixing an S3 billing edge-case! Interesting S3 cost issue in this blog: "How an empty S3 bucket can make your AWS bill explode". In brief: external unauthorised (denied) requests to a new empty S3 bucket were being charged - $1,300 within two days. The author had inadvertently chosen the same bucket name that was the placeholder default configuration in a popular open-source tool!    https://lnkd.in/eNEqedR8 That blog was published on 29th April 2024. On 13th May, AWS fixed this problem: "Amazon S3 will no longer charge for several HTTP error codes". https://lnkd.in/eMXuhhu8 To quote that announcement: "bucket owners will never incur request or bandwidth charges for requests that return an HTTP 403 (Access Denied) error response if initiated from outside their individual AWS account or AWS Organization."

6

Since we launched Redshift Streaming Ingestion with Kinesis Data Streams (KDS) and Managed Streaming for Apache Kafka (MSK) we have seen great adoption with thousands of customers ingesting data at very high rates with low latency directly to Redshift Managed Storage. One common request was to extend the ingestion capabilities to other Kafka sources. Today we are extending Redshift's Streaming Ingestion to support self-managed Apache Kafka on EC2 as well as partners, such as Confluent Cloud. Go and Ingest! https://lnkd.in/gpzC-JD2 #amazon #redshift #streaming #ingestion #kafka #confluent

202

1 Comment

Check out more on Uber's Kafaka infrastructure and the technologies supporting them. Thanks to Matt Saunders for putting this article together. Stanislav Kozlovski meshIQ The Apache Software FoundationApache Spark https://lnkd.in/eeUmcqtD

14

3 Comments

My newest blog post describes how we still work to improve the performance, security, and internal efficiency of the very first #AWS service: "Optimizing Amazon Simple Queue Service (SQS) for speed and scale" - https://lnkd.in/gjjk76Bn

257

5 Comments

➤ (Now GA) Google Distributed Cloud: Air-Gapped Appliance Why is this GA release significant for the media and entertainment industry? What does GDC AGA mean for the future of content production? 🎥 🎬 ☁  Here are 10 ways GDC can be used to accelerate content production and fuel innovation across the media and entertainment industry: ➊ Empower Remote Production - Break free from connectivity constraints and enable processing, editing, and collaboration on content in-studio, from the field, on-set, or in mobile remote units ➋ Real-Time Magic - Unleash AI for live event analysis, enable instant highlights, and offer a next-level viewer experience for audiences around the world ➌ Mobile Studio Powerhouse - Turn any location into a production hub with high-performance computing, data processing, rendering, and AI on the go ➍ Disaster-Proof Your Content - Keep the show going, no matter what with rugged, secure backup and recovery for your most valuable assets ➎ Unlock Immersive Experiences - Power AR/VR content creation and immersive experiences on-site for live events, awards shows, theme parks, theatrical premieres, and beyond ➏ Secure Your Creative Collaborations - Share sensitive scripts, dailies, and intellectual property with confidence ➐ Data Security Fortified - Protect high-value content and intellectual property with the ultimate air-gapped security ➑ Regulatory Compliance Made Easy - Meet strict industry standards with a robust, secure solution ➒ Content Delivery, Anywhere - Reach remote audiences and underserved communities with localized caches ➓ Innovation Unleashed - Explore new frontiers in content creation with on-site data processing and analysis For more info, check out our GDC GA blog post below. #Google #GoogleCloud #AI #innovation #media #entertainment

25

Amazon RDS Multi-AZ deployment with two readable standbys supports 6 additional AWS Regions Three-node Multi-AZ DB Cluster is now available in Asia Pacific (Hyderabad), Asia Pacific (Melbourne), Europe (Spain), Europe (Zurich), Middle East (UAE), and Israel (Tel Aviv) Regions. This deployment option supports minor version upgrades and system maintenance updates with typically less than one second of downtime when using Amazon RDS Proxy or any one of the open-source AWS Advanced JDBC Driver, PgBouncer, or ProxySQL. https://lnkd.in/g9D9RGVB #Amazon #RDS #PostgreSQL #MySQL

90

1 Comment

Sometimes small changes are a big deal. S3's per-account bucket limit has meant that buckets have been more of a human provisioning thing, starkly different from objects, which tend to be interacted with primarily from code. For years, customers have been asking us to increase this limit -- and in the storage innovation talk at re:Invent this year, i'd tell a bit of a story about why it was a more complicated bit of work than you might expect. With this limit increase, buckets have become a much more programmatic construct. We hear customers talking about using buckets, with these limit increases, as a way of managing data sharing with their own customers and using them to more effectively isolate data for specific jobs and teams. If larger numbers of buckets opens up a new pattern for you, I'd love to hear more about it. These launches, like object consistency, S3 conditionals, and big bucket limit increases have a tendency to fly a little below radar. But they are the ones that I actually hear the most excitement back from developers about, because they really broaden S3 as a programmatic interface to your data, and a building block for really incredible systems. I'm so impressed with the hard and careful work on the team that went in to getting this one out. https://lnkd.in/gA2cWATM

245

8 Comments

With the announcement of S3-native-streams (Freight clusters), here is a commentary on Confluent strategy regarding object storage, streaming and an open data architecture. https://lnkd.in/dTg6DKVy

49

6 Comments

🚀 Upcoming Webinar Alert! 🚀 📅 Date: Mar 14, 2024 🕘 Time: 9:00am PDT / 12:00pm EDT / 4:00pm GMT Join us to explore how Hazelcast, a leading unified real-time data platform, tackles the challenges of the #microservices maturity journey. Dive into: - Building & scaling microservices architectures - Enhancing performance, scalability, and resilience with Hazelcast 🛠️ What we'll cover: - Seamless state storage - Facilitate microservices integration - Leverage Hazelcast's computation engine Plus, get insights into Hazelcast’s advanced features for continuous development, from distributed #caching to #realtime #data processing. Register below! #Webinar #Microservices #Hazelcast #TechTalk #Innovation

3

Explore the path to interoperability in this in-depth conversation with Michael Armbrust, the original creator of #DeltaLake, and Ryan Blue, an original creator of #ApacheIceberg. For many organizations, struggling with which table format to choose delays lakehouse adoption and ultimately harms their data + AI strategy. But there is an easier way. This insightful discussion covers the evolution of open table formats, how Databricks is solving interoperability, data governance and more.

29

2 Comments

The speed at which these models improve is staggering, so is the cost to build them. Only way to keep up is to leverage principles such as AWS Bedrock so you have the flexibility you need to quickly select the model that works best for your task. https://lnkd.in/gNAR63YC https://lnkd.in/g_FtP6e9

36