Amazon takes a step toward a zero-ETL future with two announcements at re:Invent

Ron Miller
Updated ·2 min read

Amazon made a couple of announcements today at AWS re:Invent in Las Vegas that helps move data management toward a future without the need for extract transform load, or ETL.

ETL is the bane of every data scientist and team as they try to get data into shape to put it to work. As AWS CEO Adam Selipsky explained, you may have data in a number of different places like your application usage data in a database and customer reviews in your data lake. Putting them together has been a significant challenge up until now.

AWS introduced Aurora zero-ETL integration with Amazon Redshift to give customers using the Aurora database and the Redshift data warehouse the ability to move data without having to perform ETL on it.

“We've been working for a few years now and building integrations between our services to make it easier to do analytics and machine learning without having to deal with ETL,” Selipsky told the re:Invent audience.

“But what if we could do more? What if we could eliminate ETL entirely? That would be a world we would all love. This is our vision, what we're calling a zero ETL future. And in this future, data integration is no longer a manual effort,” he said. “So today I'm excited to announce the preview of a fully managed new ETL-free integration between Aurora and Redshift."

While he was at it, he announced a similar integration between Amazon Redshift and Apache Spark, the popular open source big data processing platform. It offers comparable ability to move data between the two platforms without having to extract, transform and load first.

The Redshift-Aurora integration is in preview. The Redshift-Apache Spark integration is available now across all regions.

Read more about AWS re:Invent 2022 on TechCrunch
Read more about AWS re:Invent 2022 on TechCrunch

Latest Stories

  • Can dogs eat turkey? These are the Christmas foods pets shouldn't eat during the holidays (and which ones are safe)

    Should pets consume food like turkey bones and garlic, or what about apples and baked bread? We have the answers.

  • Becoming a resident of South Dakota is easy. Some say too easy

    All you have to do to become a South Dakota resident is spend one night. Stay in a campground or hotel and then stop by one of the businesses that specialize in helping people become South Dakotans, and they’ll help you do the paperwork to gain residency in a state with no income tax and relatively cheap vehicle registration. State leaders are at a stalemate between those who say people who don’t really live in South Dakota shouldn’t be allowed to vote in local elections and those who say efforts to impose a longer residency requirement for voting violate the principle that everyone gets to vote.

  • Marlborough racing tips and best bets for today’s races

    Following today’s racing tips? In need of some guidance? Or just fancy a flutter?

  • Seafarers move global trade — and Christmas gifts. These ministries bring them holiday cheer

    On a balmy December evening, four Indian crew members, eager to go explore this Mediterranean city where their container ship docked for a few hours, turned for help to Stella Maris. “We just call them, they help us with everything,” from connecting with far-away families on video to changing currency to delivering small Christmas gifts, said second officer Sunit Kamal. Whether it’s offering religious services, helping address labor abuses, or something as practical as serving as a delivery spot for Amazon packages, faith leaders and volunteers don’t see their work as charity.

  • Nvidia, IBD Stock Of The Day, Offers Early Buy Point As It Crosses Key Levels

    Nvidia is IBD Stock Of The Day as the AI chipmaker rises above its 50-day moving average and a downward-sloping trendline.

  • Stock Market Today: Dow Jones Up As Palantir Hits Record Amid 380% Gain; Here's Why A Santa Claus Rally Is Key

    The Dow Jones rose on the stock market today. Magnificent Seven names Amazon and Nvidia were strong. American Airlines stock skidded.

  • Liverpool vs Leicester: Prediction, kick-off time, TV, live stream, team news, h2h results, odds

    Liverpool have lost just once in all competitions this season

  • I’m using five air fryers to cook Christmas dinner (plus one hob for the gravy)

    A grandmother is planning to cook Christmas dinner for 11 people using only air fryers.

  • Bill Clinton released from hospital one day after admission, aide says he had the flu

    Former President Bill Clinton was released from the hospital on Tuesday, one day after he was admitted. An aide said he was treated for the flu.

  • Here's why 25,000+ Yahoo readers love this mini chain saw

    One of our editors also swears by the cordless power tool, saying it 'cuts through branches, logs and wood with ease.'

  • Starbucks strike expands to locations in 12 states: Here's what to know

    Starbucks Workers United told USA TODAY that employees in Boston, Dallas-Fort Worth, and Portland, Oregon also joined picket lines.

  • Israeli forces kill two Palestinians in West Bank refugee camp

    JERUSALEM (Reuters) -Israeli forces killed two Palestinians in a dawn raid on Tuesday on a refugee camp near the city of Tulkarm in the Israeli-occupied West Bank, Palestinian and Israeli officials said. Khawla Abdo, a 53-year-old woman, was killed as a result of shelling by Israeli forces, while Fathi Saeed Odeh Salem, an 18-year-old man, was shot in the abdomen and chest, the Palestinian Health Ministry said.

  • The first events in 2025 for PGA Tour, LPGA, PGA Tour Champions, LIV Golf

    Don't worry, golf fans. Pro golf will be back in action before you know it.

  • Stock market today: Nasdaq, S&P 500, Dow embrace 'Santa Claus' rally ahead of Christmas break

    US stocks looked set for a mostly muted open to a final, shortened trading session before the Christmas holiday,

  • How to plan for long-term care

    Planning for retirement also means preparing for potentially huge expenses. Many elderly Americans may require paid care. So how do you balance your retirement savings with saving for long term care for you and your loved ones? Robert "Bob" Powell sits down with Sharon Carson, J.P. Morgan Asset Management Retirement Insights Strategist, and Surya Kolluri, Head of the TIAA Institute, to discuss everything there is to know about long-term care. How do you plan for needing to pay for paid care on top of your retirement savings? Kolluri and Carson offer insights on the different options Americans have when considering using caregivers for themselves and family members in this week's episode of Decoding Retirement. The truth about long-term care (:57) According to the Treasury Department, 50% of Americans will require long-term care. "The longer you live, the more the chance you're going to need it." Balancing the cost of long-term care (5:50) The reality of planning for long-term care is that there are many different factors that can impact your savings plan. "What if all of the assets are spent down on my Dad's care...is there going to be anything left for me if I need care?" Avoiding caregiving crises (20:40) Many things can go wrong when planning for using paid care. So how do you avoid the worst-case scenarios? "If you have a plan in place, you can put out the fire quicker." Video highlights: :35 - The truth about long-term care 2:00 - How to use paid care 5:45 - Balancing the cost of long-term care 8:00 -Continuing care retirement community 13:22 - Uncompensated caregivers 16:30 - How to avoid caregiving crises 20:30 - Younger generation's view on retirement Retirement planning doesn’t mean locking up your money for a rainy day and forgetting about it. Planning your future means reacting to events today. Decoding Retirement gives you the tools to navigate the years ahead, and take action now! Yahoo Finance's Decoding Retirement is hosted by Robert Powell, and produced by Austin Rivera. Find more episodes of Decoding Retirement at https://finance.yahoo.com/videos/series/decoding-retirement. Thoughts? Questions? Fan mail? Email us at yfpodcasts@yahooinc.com. Editor's note: This post was written by Austin Rivera.

  • The cross on Montreal's Mount Royal may be turning 100, but its story begins in 1643

    It's been a century since Saint-Jean-Baptiste Society gathered funds from across Quebec to build a monument to the province's history and culture.

  • 'Queen of the shore' finds community after 30 years

    Betty Birrell has been mountain biking on Vancouver's North Shore since about 1993, when she says it was an anomaly to see another woman on the trails. She's still tackling some of the toughest terrain, but after years of mostly riding alone, Birrell has recently found community in women's riding groups. (Dec. 24, 2024)

  • Did Cameron Diaz Really Punch Ed Burns in “The Holiday”? He Reveals the Truth (Exclusive)

    The 'Millers in Marriage' writer and director opens up about being in one of the most popular Christmas films of all time

  • Jimmy Fallon Reveals His Biggest Holiday Hot Take — and Which Popular Christmas Song He 'Never Liked' (Exclusive)

    The 'Tonight Show' host added a few new songs to his list of favorites this year after releasing his album 'Holiday Seasoning'

  • Newsroom Ready: 'Queen of the shore' finds community after 30 years

    Betty Birrell has been mountain biking on Vancouver's North Shore since about 1993, when she says it was an anomaly to see another woman on the trails. She's still tackling some of the toughest terrain, but after years of mostly riding alone, Birrell has recently found community in women's riding groups. (Dec. 24, 2024)