Data Engineering Podcast

OCTOBER 1, 2023

Now that AI has reached the level of sophistication seen in the various generative models it is being used to build new ETL workflows. In this episode Jay Mishra shares his experiences and insights building ETL pipelines with the help of generative AI. How can you get the best results for your use case?

Building 162

Building BI SQL Machine Learning 162

Precisely

JULY 3, 2024

Although technology has historically been a male-dominated industry, more women are continuing to enter the field. Precisely supports the growth of women in the industry and as a result, established the Precisely Women in Technology (PWIT) Program which supports women at the company. Why did you choose to pursue a career in technology?

Technology 59

Technology Programming Education Data Integration 59

Simon Späti

MARCH 9, 2021

The goal is to touch on the common data engineering challenges and using promising new technologies, tools or frameworks, which most of them I wrote about in Business Intelligence meets Data Engineering with Emerging Technologies.

Data Engineer 189

Data Engineer Data Engineering Engineering Project 189

Data Engineering Podcast

MARCH 31, 2024

Identifying and accounting for those errors is a critical piece of building trust in the organization that your data is accurate and up to date. While there are numerous products available to provide that visibility, they all have different technologies and workflows that they focus on. How is Elementary designed/implemented?

Project 130

Project Data Lake High Quality Data Data Workflow 130

Data Engineering Podcast

SEPTEMBER 17, 2023

Summary A significant amount of time in data engineering is dedicated to building connections and semantic meaning around pieces of information. Linked data technologies provide a means of tightly coupling metadata with raw information. Go to dataengineeringpodcast.com/materialize today to get 2 weeks free!

Building 189

Building SQL BI Python 189

Knowledge Hut

NOVEMBER 16, 2023

The best part to jump on the bandwagon of information technology or IT is, there is an enormous possibility for an individual if he or she starts studying for a diploma or a degree, does either a master's degree or a research course. JSP certification JSP is a Web page-building tool that allows for dynamic content.

Technology 98

Technology MySQL MongoDB Google Cloud 98

Data Engineering Podcast

NOVEMBER 19, 2023

Summary The dbt project has become overwhelmingly popular across analytics and data engineering teams. Dustin Dorsey and Cameron Cyr co-authored a practical guide to building your dbt project. In this episode they share their hard-won wisdom about how to build and scale your dbt projects.

Project 147

Project Data Lake High Quality Data SQL 147

Scott Logic

SEPTEMBER 11, 2024

In February of this year, Scott Logic announced our proposed Technology Carbon Standard , setting out an approach to describing an organisation’s technology footprint. As awareness of the environmental impact of digital infrastructure grows, it has become crucial to understand and manage technology-related emissions.

Technology 52

Technology Accessibility Accessible Project 52

Data Engineering Podcast

OCTOBER 15, 2023

Summary Building streaming applications has gotten substantially easier over the past several years. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. How can you get the best results for your use case?

Process 182

Process Building SQL BI 182

Data Engineering Podcast

APRIL 28, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines. If you've learned something or tried out a project from the show then tell us about it! Your first 30 days are free!

Building 147

Building Data Lake High Quality Data Machine Learning 147

Knowledge Hut

JULY 7, 2023

Sun Microsystems, the original makers of Java which Oracle later acquired, have kept pace with the advancement in the field of technology and the developers' needs to release new versions and introduce new features. However, some believe some emerging technologies might replace Java in the future.

Java 97

Java Technology Programming Language Scala 97

Precisely

MAY 10, 2023

Technology is a vast industry that has something for everybody. The Precisely Women in Technology (PWIT) program was designed to connect women from across the organization to one another to offer support, an internal network, and career-growth opportunities. Why did you choose to pursue a career in technology?

Technology 98

Technology Insurance Architecture Programming 98

Data Engineering Podcast

JULY 23, 2023

Summary Real-time data processing has steadily been gaining adoption due to advances in the accessibility of the technologies involved. RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team.

Building 130

Building Machine Learning SQL Python 130

Data Engineering Podcast

FEBRUARY 26, 2023

Jean-Georges Perrin was tasked with designing a new data platform implementation at PayPal and wound up building a data mesh. It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. What are the core problems that you were addressing with this project? We feel your pain.

Building 147

Building Machine Learning Metadata Data Integration 147

Precisely

APRIL 3, 2024

The Precisely Women in Technology (PWIT) network was first established to bring the women of Precisely together to create more opportunities for learning and engagement. Why did you choose to pursue a career in technology? I never thought that I would have a career in technology. What’s the biggest risk you took in your career?

Technology 59

Technology Programming Project Engineering 59

Knowledge Hut

DECEMBER 26, 2023

Technology has come a long way. With UPI, even a vegetable vendor or a small business owner can access high-end new technology (Newest tech). Go for PMP certification training and get trained as per the latest project management professional certification exam content outline. It is becoming vital as the IoT gains momentum.

Technology 98

Technology Cloud Computing Healthcare Data Science 98

Engineering at Meta

MARCH 12, 2024

By the end of 2024, we’re aiming to continue to grow our infrastructure build-out that will include 350,000 NVIDIA H100 GPUs as part of a portfolio that will feature compute power equivalent to nearly 600,000 H100s. RSC has accelerated our open and responsible AI research by helping us build our first generation of advanced AI models.

Building 145

Building Portfolio Utilities Data Storage 145

Data Engineering Podcast

MAY 5, 2024

In this episode he explains his approach to building AI in a more human-like fashion and the emphasis on learning rather than statistical prediction. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management Dagster offers a new approach to building and running data platforms and data pipelines.

Building 147

Building Data Lake High Quality Data Machine Learning 147

Precisely

JANUARY 3, 2024

Representing and supporting women in technology is an integral part of the culture at Precisely. The Precisely Women in Technology (PWIT) program was established to create a network of like-minded women who can support one another, offer mentorship, and learn from one another. Why did you choose to pursue a career in technology?

Technology 64

Technology Programming Language Programming Education 64

Simon Späti

MARCH 9, 2021

The goal is to touch on the common data engineering challenges and using promising new technologies, tools or frameworks, which most of them I wrote about in Business Intelligence meets Data Engineering with Emerging Technologies.

Data Engineer 130

Data Engineer Data Engineering Engineering Project 130

François Nguyen

MARCH 22, 2021

Just an illustration – not the truth and you certainly can do it with other technologies. How do we build data products ? There are certainly many other ways to do the same with another technologies. More than the technology chosen, it is more interesting to talk about the spirit behind these choices.

Technology 130

Technology Architecture Google Cloud Metadata 130

Precisely

FEBRUARY 7, 2024

The Precisely Women in Technology (PWIT) program was first established to create a space for women in the organization to come together. Each month, a member from the network is selected to participate in a Q&A to share more about her experience as a woman in technology. Why did you choose to pursue a career in technology?

Technology 59

Technology Data Science Programming Management 59

Knowledge Hut

JANUARY 25, 2024

With over a decade of my experience in Project management, I might have crashed about 80% of my Project. Project Crashing is not a negative or a bad thing like it sounds, instead it serves as a strategy in project management, aimed at expediting project timelines without compromising the project's scope.

Project 98

Project Management Process Certification 98

Precisely

DECEMBER 6, 2023

While it’s been mostly recognized as a male-dominated industry, the technology space is evolving to include more and more women. The Precisely Women in Technology (PWIT) program is a network of women at Precisely who come together to offer mentorship, advice, support, and more. Why did you choose to pursue a career in technology?

Technology 59

Technology Professional Services Consulting Banking 59

Data Engineering Podcast

JANUARY 28, 2024

For data engineers who battle to build and scale high quality data workflows on the data lake, Starburst powers petabyte-scale SQL analytics fast, at a fraction of the cost of traditional methods, so that you can meet all your data needs ranging from AI to data applications to complete analytics. When is Scanner the wrong choice?

Data Lake 147

Data Lake Building High Quality Data AWS 147

Precisely

SEPTEMBER 26, 2024

Building data literacy across your organization empowers teams to make better use of AI tools. However, achieving success in AI projects isn’t just about deploying advanced algorithms or machine learning models. The real challenge lies in ensuring that the data powering your projects is AI-ready.

Project 75

Project Government Data Governance Data Integration 75

Knowledge Hut

OCTOBER 23, 2023

Both the project leader and project manager roles are crucial to a project's success if project management is your area of interest as a career. Research and introspection are required to comprehend and decide which role is best for you, especially if you are interested in pursuing a career in project management.

Project 98

Project Management Generalist Algorithm 98

Precisely

NOVEMBER 8, 2023

Supporting women in technology is an integral part of Precisely’s culture and to encourage the development of more women in the industry, an internal network was established. Why did you choose to pursue a career in technology? I can’t identify a particular moment when I made the choice to “pursue a career in technology.”

Technology 64

Technology Designing Project Engineering 64

Knowledge Hut

MAY 6, 2024

Value Maximizing: The market is getting more competitive, new technologies are emerging and will soon be dominant over traditional methods so the candidate has to inspect what value can they add to their experience / knowledge to cope with all those changes and competitiveness and then adapt accordingly. ” Estimate the time & cost.

Certification 97

Certification Project Management Technology 97

Precisely

JANUARY 18, 2024

After all, mainframe technology was firmly established long before many of today’s modern innovations emerged on the scene. Mainframe modernization has accelerated in recent years, breathing new life into mainframe technology and accelerating digital transformation at organizations that rely on these systems.

Technology 52

Technology AWS Cloud Computing Data Lake 52

Knowledge Hut

JUNE 16, 2023

Blockchain technology is largely responsible for cryptocurrencies' success, and since then, demand has increased. There are plenty of career opportunities in blockchain technology. This manual will take you through careers in blockchain technology that will help you advance in this popular field. What is Blockchain?

Technology 52

Technology Programming Language Finance Computer Science 52

Data Engineering Podcast

NOVEMBER 13, 2022

Summary Building data products is an undertaking that has historically required substantial investments of time and talent. With the rise in cloud platforms and self-serve data technologies the barrier of entry is dropping. If you’ve learned something or tried out a project from the show then tell us about it!

Building 130

Building Metadata MongoDB MySQL 130

Data Engineering Podcast

MARCH 5, 2023

It's supposed to make building smarter, faster, and more flexible data infrastructures a breeze. By bringing all the layers of the data stack together, TimeXtender helps you build data solutions up to 10 times faster and saves you 70-80% on costs. We feel your pain. It ends up being anything but that.

Building 147

Building Database Design Machine Learning Metadata 147

Edureka

AUGUST 8, 2024

Project management is a versatile independent discipline, including approaches, methodologies, and applications across various industries. From traditional waterfall to agile scrum, project managers use a host of techniques to ensure the successful completion of projects.

Project 52

Project Management Healthcare Manufacturing 52

Data Engineering Podcast

OCTOBER 23, 2022

Summary Agile methodologies have been adopted by a majority of teams for building software applications. Prefect is the modern Dataflow Automation platform for the modern data stack, empowering data practitioners to build, run and monitor robust pipelines at scale. When is agile the wrong choice for a data project?

Project 130

Project Metadata MongoDB MySQL 130

Engineering at Meta

DECEMBER 6, 2023

This is the most significant milestone yet for this project, which began in earnest after Mark Zuckerberg outlined his vision for it in 2019. End-to-end encryption isn’t about the technology at its core. Some of these just had to be rebuilt from scratch, while others required deploying new applied privacy technology.

Building 144

Building Designing Consulting Coding 144

Data Engineering Podcast

AUGUST 27, 2023

RudderStack Profiles takes the SaaS guesswork and SQL grunt work out of building complete customer profiles so you can quickly ship actionable, enriched data to every downstream team. Learn more about Datafold by visiting dataengineeringpodcast.com/datafold You shouldn't have to throw away the database to build with fast-changing data.

Database 130

Database Building PostgreSQL BI 130