Analytics Vidhya

FEBRUARY 28, 2023

A collaborative and interactive workspace allows users to perform big data processing and machine learning tasks easily. In this blog post, we will take a closer look at Azure Databricks, its key features, […] The post Azure Databricks: A Comprehensive Guide appeared first on Analytics Vidhya.

Big Data 312

Big Data Machine Learning Cloud Data Process 312

Lyft Engineering

JUNE 28, 2023

In early 2022, Lyft already had a comprehensive Machine Learning Platform called LyftLearn composed of model serving , training , CI/CD, feature serving , and model monitoring systems. Lyft is a real-time marketplace and many teams benefit from enhancing their machine learning models with real-time signals.

Machine Learning 120

Machine Learning Building Kafka Metadata 120

KDnuggets

AUGUST 8, 2022

I have put this blog together to help you figure out what Instagram accounts you should follow to get the best Data Science, Machine Learning, and Artificial Intelligence content.

Machine Learning 112

Machine Learning Data Science Data 112

Knowledge Hut

APRIL 26, 2024

Datasets play a crucial role and are at the heart of all Machine Learning models. Machine Learning without data sets will not exist because ML depends on data sets to bring out relevant insights and solve real-world problems. Quality data is therefore important to ensure the efficacy of a machine learning model.

Machine Learning 98

Machine Learning Datasets Deep Learning Finance 98

Knowledge Hut

APRIL 26, 2024

Machine Learning is a sub-branch of Artificial Intelligence, used for the analysis of data. It learns from the data that is input and predicts the output from the data rather than being explicitly programmed. Machine Learning is among the fastest evolving trends in the I T industry.

Machine Learning 98

Machine Learning Algorithm Deep Learning Programming Language 98

Cloudera

NOVEMBER 1, 2023

Embrace the new capabilities Our new LLM chatbot AMP, enhanced by Pinecone’s vector database and real-time embedding ingestion, is a testament to our dedication to pushing the boundaries in applied machine learning. We invite you to explore the improved functionalities of this latest AMP.

Machine Learning 110

Machine Learning Data Ingestion Database Architecture 110

WeCloudData

MARCH 20, 2024

Machine learning is revolutionizing traffic prediction, enhancing route planning and reducing congestion in urban commuting. Explore advanced algorithms like Uni-LSTM and BiLSTM for accurate forecasts, along with Google Maps' integration of deep learning for improved ETA accuracy.

Machine Learning 97

Machine Learning Deep Learning Algorithm Utilities 97

DoorDash Engineering

NOVEMBER 28, 2023

It is amusing for a human being to write an article about artificial intelligence in a time when AI systems, powered by machine learning (ML), are generating their own blog posts. The post Transforming MLOps at DoorDash with Machine Learning Workbench appeared first on DoorDash Engineering Blog.

Machine Learning 90

Machine Learning Pipeline-centric Data Science Designing 90

Knowledge Hut

JANUARY 16, 2024

Embarking on a journey in the highly demanded field of Machine Learning (ML) opens doors to diverse career opportunities. The avenues to acquire the essential skills for a career in ML are plentiful, ranging from Machine Learning online courses and certifications to formal degree programs. What Is Machine Learning?

Machine Learning 98

Machine Learning Engineering Programming Language Algorithm 98

Analytics Vidhya

FEBRUARY 6, 2023

Introduction The demand for data to feed machine learning models, data science research, and time-sensitive insights is higher than ever thus, processing the data becomes complex. In this blog, we will […] The post How to Implement a Data Pipeline Using Amazon Web Services?

Amazon Web Services 219

Amazon Web Services Data Pipeline Machine Learning Data Science 219

Cloudera

NOVEMBER 13, 2024

Users can immediately export a fine-tuned model as a Cloudera Machine Learning Model endpoint , which can then be used in production-ready workflows. On the Monitor Training Jobs page we can track the status of our training job, and also follow the deep link to the Cloudera Machine Learning Job directly to view log outputs.

Datasets 87

Datasets Machine Learning Coding Data Preparation 87

Pinterest Engineering

APRIL 4, 2025

In this blog, we will go through the technical design and share some offline and online results for our LLM-based search relevance pipeline. Pin Text Representations Pins on Pinterest are rich multimedia entities that feature images, videos, and other contents, often linked to external webpages or blogs.

Machine Learning 56

Machine Learning Metadata Architecture Datasets 56

Analytics Vidhya

FEBRUARY 20, 2023

Introduction Machine Learning is a fast-growing field, and its applications have become ubiquitous in our day-to-day lives. As the demand for ML models increases, so makes the demand for user-friendly interfaces to interact with these models.

Python 152

Python Building Machine Learning Business Intelligence 152

databricks

DECEMBER 22, 2023

This blog focuses on its application. Introduction Anomaly detection is widely applied across various industries, playing a significant role in the enterprise sector.

Machine Learning 105

Machine Learning Building IT 105

Netflix Tech

MARCH 4, 2024

In this blog post, we present our project on Auto Remediation, which integrates the currently used rule-based classifier with an ML service and aims to automatically remediate failed jobs without human intervention. Right Sizing is in progress and will be covered with more details in a dedicated technical blog post later. Stay tuned.

Machine Learning 86

Machine Learning Big Data Data Engineering 86

LinkedIn Engineering

NOVEMBER 27, 2023

In this blog, we will discuss how this new framework makes it easier for reviewers to find and handle content that needs a human touch, while reducing the average time it takes to detect content that doesn’t align with our policies by 60%. This helps our reviewers prioritize which content needs immediate attention.

Machine Learning 87

Machine Learning Data Science Engineering Systems 87

Pinterest Engineering

JANUARY 31, 2025

Methods A two tower-based approach has been widely adopted in industry [6], where one tower learns the query embedding and one tower learns the item embedding. This section illustrates the current machine learning design of the two-tower machine learning model for learned retrieval at Pinterest.

Systems 67

Systems Metadata Machine Learning Architecture 67

Cloudera

DECEMBER 4, 2024

Today, Artificial Intelligence (AI) and Machine Learning (ML) are more crucial than ever for organizations to turn data into a competitive advantage. The post Cloudera AI Inference Service Enables Easy Integration and Deployment of GenAI Into Your Production Environments appeared first on Cloudera Blog. Why did we build it?

Architecture 73

Architecture Machine Learning Deep Learning BI 73

Data Engineering Weekly

NOVEMBER 24, 2024

The blog highlights how moving from 6-character base-64 to 20-digit base-2 file distribution brings more distribution in S3 and reduces request failures. The blog is a good summary of how to use Snowflake QUERY_TAG to measure and monitor query performance. The blog post made me curious to understand DataFusion's internals.

Data Engineer 58

Data Engineer Data Engineering Engineering Insurance 58

Uber Engineering

AUGUST 5, 2021

Uber delivers efficient and reliable transportation across the global marketplace, which is powered by hundreds of services, machine learning models, and tens of thousands of datasets.

Transportation 145

Transportation Datasets Machine Learning Data 145

Uber Engineering

JULY 22, 2021

As Uber’s business grew, we scaled our Apache Hadoop (referred to as ‘Hadoop’ in this article) deployment to 21000+ hosts in 5 years, to support the various analytical and machine learning use cases.

Hadoop 145

Hadoop Machine Learning Engineering Architecture 145

KDnuggets

FEBRUARY 1, 2024

Learn about the most common questions asked during data science interviews. This blog covers non-technical, Python, SQL, statistics, data analysis, and machine learning questions.

Data Science 140

Data Science Machine Learning SQL Data Analysis 140

Data Engineering Weekly

OCTOBER 27, 2024

The blog is an excellent summary of the existing unstructured data landscape. The learning mostly involves understanding the data's nature, frequency of data processing, and awareness of the computing cost. It is exciting to read probably the first blog on building a vector search infrastructure at scale.

Data Engineer 58

Data Engineer Data Engineering Engineering Unstructured Data 58

Data Engineering Podcast

APRIL 21, 2024

Contact Info LinkedIn Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? The Machine Learning Podcast helps you go from idea to production with machine learning. Closing Announcements Thank you for listening!

Data Lake 182

Data Lake High Quality Data Machine Learning Data Pipeline 182

Netflix Tech

DECEMBER 19, 2024

This followed a previous blog on the same topic. Metaboost serves as a single interface to three different internal platforms at Netflix that manage ETL/Workflows ( Maestro ), Machine Learning Pipelines ( Metaflow ) and Data Warehouse Tables ( Kragle ).

Machine Learning 81

Machine Learning Project Data Warehouse Coding 81

KDnuggets

SEPTEMBER 12, 2023

This blog discusses vector databases, specifically pinecone vector databases. This allows for efficient similarity and distance calculations, making it useful for tasks like machine learning, data analysis, and recommendation systems. These vectors have multiple dimensions, capturing complex data relationships.

Database 132

Database Machine Learning Data Analysis Systems 132

Analytics Vidhya

MARCH 10, 2023

In this blog post, we […] The post Explore the World of Data-Tech with DataHour appeared first on Analytics Vidhya. Current professionals seeking to transition into the data-tech domain or data science professionals seeking to enhance their career growth and development can also benefit from these sessions.

Data Science 248

Data Science Data MySQL Machine Learning 248

Pinterest Engineering

FEBRUARY 3, 2025

Learned Retrieval) is a key candidate generator to retrieve highly personalized, engaging, and diverse content to fulfill various user intents and enable multiple actionability, such as Pin saving and shopping. Acknowledgment This blog represents a variety of workstreams on embedding-based retrieval across many teams at Pinterest.

Machine Learning 49

Machine Learning Engineering Architecture Systems 49

KDnuggets

MAY 18, 2022

Complete guide and blog post series on IT Operations Management with AIOps. Using AI and Machine Learning to manage IT complexity to deliver world class IT service while keeping the lights on.

IT 123

IT Management Machine Learning 123

Data Engineering Podcast

FEBRUARY 26, 2023

Contact Info LinkedIn Blog Parting Question From your perspective, what is the biggest gap in the tooling or technology for data management today? The Machine Learning Podcast helps you go from idea to production with machine learning. Closing Announcements Thank you for listening!

Building 147

Building Machine Learning Metadata Data Integration 147

databricks

AUGUST 2, 2024

Training a high-quality machine learning model requires careful data and feature preparation. To fully utilize raw data stored as tables in Databricks, running.

Engineering 135

Engineering Raw Data Machine Learning Utilities 135

Cloudera

JANUARY 7, 2025

Image: Cloudera Observability Features Leveraging AI and Machine Learning in a Hybrid Environment A hybrid approach is ideal for deploying AI and ML. The post Mastering Multi-Cloud with Cloudera: Strategic Data & AI Deployments Across Clouds appeared first on Cloudera Blog.

Cloud 82

Cloud Government AWS Unstructured Data 82

databricks

MARCH 21, 2023

This blog is authored by Mohamed Afifi Ibrahim, Principal Machine Learning Engineer at Barracuda Networks. 74% of organizations globally have fallen victim to.

Machine Learning 105

Machine Learning Engineering 105

Data Engineering Weekly

JUNE 24, 2024

The blog contains a summary of each talk and a link to the YouTube channel with all the talks. The blog details the classification model, training approach and historical data analysis. link] Influx Data: How Good is Parquet for Wide Tables (Machine Learning Workloads) Really? Are there enough usecases?

Data Engineer 110

Data Engineer Data Engineering Engineering Google Cloud 110

Edureka

APRIL 22, 2025

Integration of AI and Machine Learning Microsoft Fabric: Connects to Notebooks, OpenAI APIs, and Azure Machine Learning. Here’s a quick comparison: Choose Fabric if: You need an all-in-one SaaS platform that combines Power BI, data engineering, real-time analytics, and machine learning.

BI 52

BI Pipeline-centric Data Lake Google Cloud 52

Edureka

APRIL 22, 2025

This blog will explore the significant advancements, challenges, and opportunities impacting data engineering in 2025, highlighting the increasing importance for companies to stay updated. In 2025, this blog will discuss the most important data engineering trends, problems, and opportunities that companies should be aware of.

Data Engineer 52

Data Engineer Data Engineering Engineering Consulting 52

Snowflake

NOVEMBER 11, 2024

To learn more about these new features and related updates check out our Cortex Analyst blog post. Together, these updates empower enterprises to securely derive accurate, timely insights from their data, reducing the overall cost of data-driven decision-making.

Unstructured Data 98

Unstructured Data SQL AWS Healthcare 98