KDnuggets
MARCH 4, 2022
How do you keep up with all the news and trends, and navigate through the endless stream of AI information? Check out this author's list of favorite AI papers sources that help you float effortlessly in the info ocean.
Cloudera
MARCH 3, 2022
Whether the enterprise uses dozens or hundreds of data sources for multi-function analytics, all organizations can run into data governance issues. Bad data governance practices lead to data breaches, lawsuits, and regulatory fines — and no enterprise is immune. . Everyone Fails Data Governance. In 2019, the U.K.’s Information Commissioner’s Office fined Marriott International over £99 million ($136 million) for violating the General Data Protection Regulation (GDPR), a European law govern
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Data Engineering Podcast
FEBRUARY 27, 2022
Summary There are a wealth of options for managing structured and textual data, but unstructured binary data assets are not as well supported across the ecosystem. As organizations start to adopt cloud technologies they need a way to manage the distribution, discovery, and collaboration of data across their operating environments. To help solve this complicated challenge Krishna Subramanian and her co-founders at Komprise built a system that allows you to treat use and secure your data wherever
Rockset
MARCH 4, 2022
Amazon Kinesis is a platform to ingest real-time events from IoT devices, POS systems, and applications, producing many kinds of events that need real-time analysis. Due to Rockset 's ability to provide a highly scalable solution to perform real-time analytics of these events in sub-second latency without worrying about schema, many Rockset users choose Kinesis with Rockset.
Speaker: Tamara Fingerlin, Developer Advocate
Apache Airflow® 3.0, the most anticipated Airflow release yet, officially launched this April. As the de facto standard for data orchestration, Airflow is trusted by over 77,000 organizations to power everything from advanced analytics to production AI and MLOps. With the 3.0 release, the top-requested features from the community were delivered, including a revamped UI for easier navigation, stronger security, and greater flexibility to run tasks anywhere at any time.
KDnuggets
MARCH 4, 2022
While there may always seem to be something new, cool, and shiny in the field of AI/ML, classic statistical methods that leverage machine learning techniques remain powerful and practical for solving many real-world business problems.
Cloudera
MARCH 2, 2022
Risk management is a highly dynamic discipline these days. Stress testing is a particular area that has become even more important throughout the pandemic. Stress tests conducted by authorities such as the Federal Reserve Bank in the US are designed to keenly monitor the financial stability of the banking sector, especially during economic downturns such as those brought on by the pandemic.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
|
Elder Research
MARCH 3, 2022
The post Defying Gravity appeared first on Elder Research.
KDnuggets
MARCH 3, 2022
In the Cybersecurity sector Adversarial machine learning attempts to deceive and trick models by creating unique deceptive inputs, to confuse the model resulting in a malfunction in the model. .
Cloudera
MARCH 2, 2022
Apache Impala is used today by over 1,000 customers to power their analytics in on premise as well as cloud-based deployments. Large user communities of analysts and developers benefit from Impala’s fast query execution, helping them get their work done more effectively. For these users performance and concurrency are always top of mind. . An important technique to ensure good performance and concurrency is through efficient usage of memory.
Rockset
MARCH 3, 2022
Today Rockset is announcing an early access program for Oracle and Microsoft SQL Server integrations. Oracle and Microsoft SQL Server (MSSQL) are both incredibly popular database products for transactional workloads at large enterprises. The amount of data companies generate, transform, store and query is growing exponentially. This data has material financial value when it’s both fresh and easy to access, however, customers commonly face scalability challenges running both transactional and ana
Speaker: Alex Salazar, CEO & Co-Founder @ Arcade | Nate Barbettini, Founding Engineer @ Arcade | Tony Karrer, Founder & CTO @ Aggregage
There’s a lot of noise surrounding the ability of AI agents to connect to your tools, systems and data. But building an AI application into a reliable, secure workflow agent isn’t as simple as plugging in an API. As an engineering leader, it can be challenging to make sense of this evolving landscape, but agent tooling provides such high value that it’s critical we figure out how to move forward.
Pipeline Data Engineering
MARCH 2, 2022
Data engineering salon. News and interesting reads about the world of data. The Unbundling of Airflow Gorkem Yurtseven, Co-Founder, Features and Labels A diverse set of tools is unbundling Airflow and this diversity is causing substantial fragmentation in modern data stack. Rebundling the Data Platform Nick Schrock, Founder, Elementl A fundamentally new approach to orchestration that orients around assets rather than tasks.
KDnuggets
MARCH 2, 2022
Analysts predict an AI boom, driven by possibilities and record funding. While challenges remain, a hybrid approach combining the best of the realm may finally send it sailing into the mainstream.
Trio
MARCH 1, 2022
Agile frameworks are by no means neglected in the software development world. Agile methodologies are praised for their ability to reduce risks and keep consumers satisfied.
Monte Carlo
MARCH 1, 2022
Our Python SDK gives data engineers programmatic access to Monte Carlo to augment our data observability platform’s lineage, cataloging, and monitoring functionalities. We are excited to announce the release of Monte Carlo’s Python SDK (Pycarlo), a new way for data engineers to create data applications directly on top of our data observability platform.
Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives
Manufacturing is evolving, and the right technology can empower—not replace—your workforce. Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it? Join industry expert Andrew Skoog as he explores how manufacturers can leverage automation to enhance operations, streamline workflows, and make smarter, data-dri
dbt Developer Hub
MARCH 1, 2022
Executive Summary: If your company is struggling to leverage analytics, dealing with an overgrown ecosystem of dashboards/databases or simply want to avoid the mistakes of others, this story is for you. In this article, I will walk through forming the first analytics engineering team at Smartsheet including how momentum built around forming the team, the challenges we faced, and the solutions we developed within the first year.
KDnuggets
MARCH 4, 2022
CV has the potential to transform industries and how they operate. Here are some of the most notable applications worth exploring.
Trio
MARCH 1, 2022
What Is a Tech Stack and How To Choose the Right One? In spite of its name, a tech stack has little to do with pancakes or money. Instead a tech stack, is a necessary part of every software development project.
ProjectPro
FEBRUARY 28, 2022
Facial Expression Recognition (FER) based technologies are an integral part of the emotion recognition market, which is anticipated to reach $56 billion by 2024—detecting Emotions? Using AI? Can we really do that? The answer is YES! One can easily build a facial emotion recognition project in Python. Continue reading to find the answer to how you can do that.
Advertisement
With Airflow being the open-source standard for workflow orchestration, knowing how to write Airflow DAGs has become an essential skill for every data engineer. This eBook provides a comprehensive overview of DAG writing features with plenty of example code. You’ll learn how to: Understand the building blocks DAGs, combine them in complex pipelines, and schedule your DAG to run exactly when you want it to Write DAGs that adapt to your data at runtime and set up alerts and notifications Scale you
KDnuggets
MARCH 3, 2022
This article will solely focus on learning linear algebra, as it forms the backbone of machine learning model implementation.
KDnuggets
MARCH 1, 2022
Check out this curated collection for new and popular tools to add to your data stack this year.
KDnuggets
MARCH 1, 2022
Also: Decision Tree Algorithm, Explained; The Complete Collection of Data Science Cheat Sheets – Part 1; Essential Machine Learning Algorithms: A Beginner’s Guide; An Easy Guide to Choose the Right Machine Learning Algorithm.
KDnuggets
MARCH 1, 2022
Many companies have been capturing customer data in some form or another for decades. Petabytes of data are traversing networks worldwide every day, and all of that data means big money. Here's how companies can best utilize this data to influence positive outcomes.
Speaker: Tamara Fingerlin, Developer Advocate
In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!
KDnuggets
FEBRUARY 28, 2022
Unless you have a basic knowledge of calculus, you cannot understand how machine learning algorithms are developed. Calculus for Machine Learning is designed for developers to get you up to speed on the calculus that you need for applied machine learning. The book has more math than our other books and over 85 code examples to help you understand the concepts.
KDnuggets
FEBRUARY 28, 2022
Datasets - properly curated and labeled - remain a scarce resource. What can be done about this?
KDnuggets
MARCH 2, 2022
When it comes to Data Science, many people affiliate the career path as being ‘nerdy’. An industry for men, smart men; pushing women further and further away from the career. What can be done about this, and why is it important?
KDnuggets
FEBRUARY 28, 2022
If you’re looking to put your skills to the test, here are the top six startups you should consider working for in 2022.
Speaker: Ben Epstein, Stealth Founder & CTO | Tony Karrer, Founder & CTO, Aggregage
When tasked with building a fundamentally new product line with deeper insights than previously achievable for a high-value client, Ben Epstein and his team faced a significant challenge: how to harness LLMs to produce consistent, high-accuracy outputs at scale. In this new session, Ben will share how he and his team engineered a system (based on proven software engineering approaches) that employs reproducible test variations (via temperature 0 and fixed seeds), and enables non-LLM evaluation m
KDnuggets
MARCH 2, 2022
Telling a Great Data Story: A Visualization Decision Tree; What Is the Difference Between SQL and Object-Relational Mapping (ORM)?; Top 7 YouTube Courses on Data Analytics ; How Much Do Data Scientists Make in 2022?; Design Patterns in Machine Learning for MLOps.
KDnuggets
FEBRUARY 28, 2022
The analytics team at Intelligence Node have been working on developing a Limited Memory model (which first started as a Reactive model) aka the 'The Probability of Future Success' model. This model explores a new market driven approach to identifying future trends and probability of success for specific product attributes based on a series of dynamic metrics and attributes.
KDnuggets
MARCH 2, 2022
This article will discuss 3 possible ways of getting into the field of data science.
KDnuggets
MARCH 1, 2022
The 2022 INFORMS Business Analytics Conference comes to Houston, TX, April 3-5. Discover dozens of real-world case studies highlighting how data science and analytics professionals are empowering organizations to make data-driven decisions.
Advertisement
Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.
Expert insights. Personalized for you.
160 
Let's personalize your content