KDnuggets
OCTOBER 7, 2022
There is no shortage of tools today that can help you through the steps of natural language processing, but if you want to get a handle on the basics this is a good place to start. Read about the ABCs of NLP, all the way from A to Z.
Jesse Anderson
OCTOBER 5, 2022
My guest this week is Brent Dykes , Founder and Chief Data Storyteller at Analytics Hero. Before he founded his own company, he was at Omniture, Adobe, and Domo. Analytics Hero is a consulting business based around data storytelling Data storytelling was a new concept to me. Brent defines it as “as a structured approach for communicating insights to a targeted audience using narrative elements and explanatory visuals.
Confluent
OCTOBER 3, 2022
Apache Kafka 3.3 includes KRaft mode, improves partition scalability and resiliency while simplifying Kafka deployment, as well as updates to Kafka Streams, Connect, and more.
Data Engineering Podcast
OCTOBER 2, 2022
Summary The global economy is dependent on complex and dynamic networks of supply chains powered by sophisticated logistics. This requires a significant amount of data to track shipments and operational characteristics of materials and goods. Roambee is a platform that collects, integrates, and analyzes all of that information to provide companies with the critical insights that businesses need to stay running, especially in a time of such constant change.
Advertisement
Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.
KDnuggets
OCTOBER 4, 2022
Among the four big NoSQL database types, key-value stores are probably the most popular ones due to their simplicity and fast performance. Let’s further explore how key-value stores work and what are their practical uses.
Cloudera
OCTOBER 6, 2022
Digital transformation. Everyone has their own ideas about what digital transformation means, so I decided to look up a few definitions. . Gartner : “Digital transformation can refer to anything from IT modernization (for example, cloud computing), to digital optimization, to the invention of new digital business models.”. CIO blog post : “Digital transformation is a foundational change in how an organization delivers value to its customers.”.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
Data Engineering Podcast
OCTOBER 2, 2022
Summary Data lineage is something that has grown from a convenient feature to a critical need as data systems have grown in scale, complexity, and centrality to business. Alvin is a platform that aims to provide a low effort solution for data lineage capabilities focused on simplifying the work of data engineers. In this episode co-founder Martin Sahlen explains the impact that easy access to lineage information can have on the work of data engineers and analysts, and how he and his team have de
Cloudera
OCTOBER 3, 2022
Tell us if this sounds familiar. You’ve found an awesome data set that you think will allow you to train a machine learning (ML) model that will accomplish the project goals; the only problem is the data is too big to fit in the compute environment that you’re using. In the day and age of “big data,” most might think this issue is trivial, but like anything in the world of data science things are hardly ever as straightforward as they seem. .
Confluent
OCTOBER 4, 2022
Confluent’s new Stream Designer is the industry’s first visual interface for rapidly building, testing, and deploying streaming data pipelines natively on Apache Kafka.
Speaker: Tamara Fingerlin, Developer Advocate
In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!
Teradata
OCTOBER 7, 2022
There are various approaches to doing time-series forecasting. Amongst all the approaches, the right way is using an in-database approach. Read more to find out why.
KDnuggets
OCTOBER 5, 2022
What is NLP, and what types of questions related to NLP can you expect at the NLP-related job interviews?
Cloudera
OCTOBER 7, 2022
Introduction. dbt allows data teams to produce trusted data sets for reporting, ML modeling, and operational workflows using SQL, with a simple workflow that follows software engineering best practices like modularity, portability, and continuous integration/continuous development (CI/CD). We’re excited to announce the general availability of the open source adapters for dbt for all the engines in CDP — Apache Hive , Apache Impala , and Apache Spark, with added support for Apache Livy and Cloude
DataKitchen
OCTOBER 5, 2022
Part 1: Defining the Problems. This is the first post in DataKitchen’s four-part series on DataOps Observability. Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately.
Advertisement
Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.
Confluent
OCTOBER 3, 2022
Announcing Confluent for Startups! Get started with Apache Kafka, leverage our data streaming expertise, and set your business up with the best infrastructure for scale and success.
KDnuggets
OCTOBER 5, 2022
A comprehensive guide on optimizing model hyperparameters with Scikit-Learn.
Cloudera
OCTOBER 4, 2022
This blog post will provide guidance to administrators currently using or interested in using Kafka nodes to maintain cluster changes as they scale up or down to balance performance and cloud costs in production deployments. Kafka brokers contained within host groups enable the administrators to more easily add and remove nodes. This creates flexibility to handle real-time data feed volumes as they fluctuate.
phData: Data Engineering
OCTOBER 7, 2022
So you’ve built your first set of transformations in dbt , but now you need to figure out how to automate your deployment and code changes to your various environments. However, you’re not sure where to even start planning, let alone making sure that you’re sticking to best practices (whether that’s running your code on a schedule or having it run based on certain actions within your git repository).
Advertisement
Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?
Confluent
OCTOBER 7, 2022
From real-time banking and mobile payments, learn how Apache Kafka and Confluent are powering the financial services industry with event-driven architecture for modern use cases.
KDnuggets
OCTOBER 5, 2022
Digital transformation is evolving, and so is the fintech industry by implementing AI trends and leveraging several benefits, such as optimizing productivity, increasing ROI, and enhancing security.
Cloudera
OCTOBER 1, 2022
While the word “data” has been common since the 1940s, managing data’s growth, current use, and regulation is a relatively new frontier. . Governments and enterprises are working hard today to figure out the structures and regulations needed around data collection and use. According to Gartner, by 2023 65% of the world’s population will have their personal data covered under modern privacy regulations. .
Emeritus
OCTOBER 6, 2022
Everyone leveraged data from small-scale enterprises to Fortune 500 companies to ensure efficient operations. Frontrunners like the MAANG companies (Meta, Amazon, Apple, Netflix, and Google), have vast databases that hold a wide range of customer data. Here is where database management systems like MS Access come in, and a programming language known as Structured Query… The post What is SQL?
Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali
As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.
Monte Carlo
OCTOBER 6, 2022
Will Larson (writer of An Elegant Puzzle – recommended read) may have said it best when he wrote that one of the best kinds of reorganization is the one you don’t do. However, data leaders inevitably reach a point where, due to team growth or evolving business demands, things just don’t work. Faced with these challenges, data organizations may swing back-and-forth between centralized vs. decentralized organizational structures until they achieve the right balance.
KDnuggets
OCTOBER 7, 2022
We have compiled a list of the top free resources to help new data practitioners learn SQL. These include free online courses and resources to get the most out of your SQL skills.
Rockset
OCTOBER 6, 2022
Open source PyTorch runs tens of thousands of tests on multiple platforms and compilers to validate every change as our CI (Continuous Integration). We track stats on our CI system to power custom infrastructure, such as dynamically sharding test jobs across different machines developer-facing dashboards, see hud.pytorch.org , to track the greenness of every change metrics, see hud.pytorch.org/metrics , to track the health of our CI in terms of reliability and time-to-signal Our requirements for
Meltano
OCTOBER 5, 2022
Interested in becoming a data engineer? The need for data experts in the U.S. job market is expected to grow by 22% in this decade, and according to LinkedIn’s 2020 report , a data engineer is listed as the 8th fastest growing job today. But what is data engineering exactly and what does a data engineer do? Interested in a data platform? We’ll explain what a data engineer is, what the job entails, and how to become a data engineer.
Speaker: Nikhil Joshi, Founder & President of Snic Solutions
Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.
Picnic Engineering
OCTOBER 5, 2022
Picnic loves Error Prone: producing high-quality and consistent Java code Error Prone Support is now open source! Check out the announcement. Picnic is changing the way people do groceries. We’re an app-only supermarket, delivering the highest quality products for the best price to our customers. To do this, we meticulously design and build products for our customers and internal users.
KDnuggets
OCTOBER 6, 2022
This article is about 3 ways you can process a CSV file using Python.
DataKitchen
OCTOBER 5, 2022
Part 1: Defining the Problems. This is the first post in DataKitchen’s four-part series on DataOps Observability. Observability is a methodology for providing visibility of every journey that data takes from source to customer value across every tool, environment, data store, team, and customer so that problems are detected and addressed immediately.
Meltano
OCTOBER 5, 2022
Data is becoming the world’s most valuable resource, according to an article in The Economist dating back to 2017. Since then, the way we compile, process, and store data has evolved significantly, and it continues to do so at incredible speed. As more data becomes available, the demand for faster, improved, error-free analytics grows. Who exactly is challenged with meeting this demand?
Advertisement
Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.
Expert insights. Personalized for you.
160 
Let's personalize your content