Sat.Dec 31, 2022 - Fri.Jan 06, 2023

article thumbnail

Why I'm using (Neo)vim as a Data Engineer and Writer in 2023

Simon Späti

I used VS Code, Sublime, Notepad++, TextMate, and others, but the shortcut with cmd(+shift)+end, jumping with option+arrow-keys from word to word, needed to be faster at some point. I was hitting my limits. Everything I was doing I did decently fast, but I didn’t get any faster. Vim is the only editor you get faster with time. Vim is based solely on shortcuts.

article thumbnail

Python Matplotlib Cheat Sheets

KDnuggets

Matplotlib is the most famous and commonly used plotting library in Python. It allows you to create clear and interactive visualizations that make your data easier to understand and your results more concrete.

Python 160
article thumbnail

Confluent + Immerok: Cloud Native Kafka Meets Cloud Native Flink

Confluent

Introducing fully managed Apache Kafka® + Flink for the most robust, cloud-native data streaming platform with stream processing, integration, and streaming analytics in one.

Kafka 145
article thumbnail

CircleCI’s unnoticed holiday security breach

The Pragmatic Engineer

Originally published on 5 January 2023. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of seven topics in today’s subscriber-only The Scoop issue. To get this newsletter every week, subscribe here. For most engineering teams, returning from the winter holiday usually involves gradually getting back into the swing of things.

article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

Why Vim Is More than Just an Editor – Vim Language, Motions, and Modes Explained

Simon Späti

Throughout my time as a developer, I’ve used VS Code, Sublime, Notepad++, TextMate, and others. But shortcuts like cmd(+shift)+end and jumping with option+arrow-keys from word to word needed to be faster at some point. I was hitting my limits. Everything I was doing I did decently fast, but I didn’t get any faster. I’ve since learned that Vim is the only editor that you get faster using with time.

Coding 130
article thumbnail

A Solid Plan for Learning Data Science, Machine Learning, and Deep Learning

KDnuggets

Check out this solid plan for learning Data Science, Machine Learning, and Deep Learning. The entire plan is currently available at no cost to KDnuggets readers.

More Trending

article thumbnail

4 Tips for Agility and Resiliency Through Supply Chain Process Automation

Precisely

Times are changing, and at a near-constant pace. With shifting customer preferences and disruptive world events shaking up the global supply chain market, many business leaders are left wondering whether they’ll be able to stay competitive. Supply chain automation technologies can have a big role to play when it comes to providing end-to-end visibility and risk mitigation for complex, data-intensive SAP processes in supply chain.

Process 59
article thumbnail

The Open Data Stack Distilled into Four Core Tools

Simon Späti

In this article, we are going to explore core open-source tools that are needed for any company to become data-driven. We’ll cover integration, transformation, orchestration, analytics, and ML tools as a starter guide to the latest open data stack. Let’s start with the Modern Data Stack. Have you heard of it or where the term came from?

Data 130
article thumbnail

Free Data Management with Data Science Learning with CS639

KDnuggets

Learn Data Management with Data Science for FREE with CS639.

article thumbnail

Meaningful Product Experimentation: 5 Impactful Data Projects for Building Better Products

Monte Carlo

Understanding and aligning with each business domain’s unique incentives and workflows is what ultimately makes data teams not just efficient, but great. Part one of this series looked at everyone’s favorite spreadsheet power users: the finance team. This article will examine how data teams can better conduct product experimentation and better align with product teams.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Clustering on Normal, CLONE, COPY tables

Cloudyard

Read Time: 2 Minute, 32 Second During this post we will discuss multiple scenario on Clustering Tables. We will be analyzing and implementing the following scenarios in this post. Non Cluster to Cluster table : Create Clustering on Normal table and see the partitions pruning. CLONE Cluster table: CLONE the above Clustered table and analyze the Clustering.

IT 52
article thumbnail

What is ESG?

Precisely

Environmental, social, and governance (ESG) initiatives are topics of discussion everywhere – in the workplace, social media, news outlets, and beyond. And for good reason. Recent public advocacy efforts around climate issues, diversity and inclusion, data privacy, and more have been driving forces in pushing ESG to the forefront. While stellar products and services used to be enough for businesses to attract new customers, investors, and employees – and win their loyalty over time – that’s not

article thumbnail

Python Lambda Functions, Explained

KDnuggets

Learn the syntax and uses of the lambda function, which is an alternative to the regular Python function.

Python 143
article thumbnail

Teradata’s Top 10 Innovations in 2022

Teradata

As we start 2023, our product marketing team has compiled a list of the top 10 features in Teradata Vantage which have immensely helped our customers and are technological breakthroughs.

article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

What is ChatGPT?

Elder Research

The post What is ChatGPT? appeared first on Elder Research.

52
article thumbnail

How Corning Built End-to-end ML on Databricks Lakehouse Platform

databricks

“This blog is authored by Denis Kamotsky, Principal Software Engineer at Corning” Corning has been one of the world’s leading innovators in materials scien.

article thumbnail

Natural Language Processing with spaCy

KDnuggets

Learn to build NLP projects using spaCy.

Process 143
article thumbnail

Real-World Data Governance: The Role of Data Governance in a Data Strategy

Precisely

Does your company have a formal data strategy? If so, does that strategy effectively lay out a path toward better business outcomes by helping you optimize your use of data? Although it is a given that data can be one of a company’s real differentiators if used properly, many organizations still do not have a comprehensive data strategy in place.

article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

2023 Predictions: Data Trends That Will Dominate Business Agenda in APAC

Cloudera

In the past year, businesses who doubled down on digital transformation during the pandemic saw their efforts coming to fruition in the form of cost savings and more streamlined data management. Faced with even more pressure to remain resilient and agile amid looming global economic threats, Asia-Pacific (APAC) region businesses are looking to further mobilize emerging technologies such as artificial intelligence (AI) and machine learning that will optimize operational efficiencies and cost savi

Banking 52
article thumbnail

Products We Think You Might Like: Generating Personalized Recommendations Using Matrix Factorization

databricks

Check our Solution Accelerator for Matrix Factorization for more details and to download the notebooks. Recommenders are a critical part of the modern.

Retail 52
article thumbnail

How to Merge Pandas DataFrames

KDnuggets

Data merge is a common data processing activity. Learn how Pandas provide various ways to merge our data.

article thumbnail

Now in Preview: Webhook Data Source | Propel Data Analytics Blog

Propel Data

Easily get your data into Propel to power a variety of customer-facing analytics use cases.

article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

A Guide to Data Contracts

Striim

Companies need to analyze large volumes of datasets, leading to an increase in data producers and consumers within their IT infrastructures. These companies collect data from production applications and B2B SaaS tools (e.g., Mailchimp). This data makes its way into a data repository, like a data warehouse (e.g., Redshift), and is shown to users via a dashboard for decision-making.

article thumbnail

Building Geospatial Data Products

databricks

Geospatial data has been driving innovation for centuries, through use of maps, cartography and more recently through digital content. For example, the oldest.

article thumbnail

SQL With CSVs

KDnuggets

Write SQL query to analyze CSV files using the simple command line tool.

SQL 134
article thumbnail

How Collaborative Imaging Delivers Healthier Data Products with Monte Carlo

Monte Carlo

As a radiologist-owned alliance built by physicians, Collaborative Imaging knows a thing or two about what it means to be healthy. And the same goes for their data. From revenue cycle management to telehealth, Collaborative Imaging ’s physician-conceived platform is solving some of the biggest technology challenges facing modern medical practices. And with hundreds of hospitals utilizing Collaborative Imaging’s data products to optimize their practices, data quality is paramount for the data tea

article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

Selecting the Best Image for Each Merchant Using Exploration and Machine Learning

DoorDash Engineering

In order to inspire DoorDash consumers to order from the platform there are few tools more powerful than a compelling image, which raises the questions: what is the best image to show each customer, and how can we build a model to determine that programmatically using each merchant’s available images? Figure 1: Discovery surfaces with merchant images Out of all the different information presented on the home page (see Figure 1), studies with consumers have repeatedly shown that images play the m

article thumbnail

Recycling Kubernetes Nodes

Yelp Engineering

Manually managing the lifecycle of Kubernetes nodes can become difficult as the cluster scales. Especially if your clusters are multi-tenant and self-managed. You may need to replace nodes for various reasons, such as OS upgrades and security patches. One of the biggest challenges is how to terminate nodes without disturbing tenants. In this post, I’ll describe the problems we encountered administering Yelp’s clusters and the solutions we implemented.

article thumbnail

Top Data Python Packages to Know in 2023

KDnuggets

These Python packages would improve your data workflow.

Python 131
article thumbnail

Achieve Your Goals With Databricks Certifications

databricks

Elevate your career in the New Year! Start the new year off right by taking your Databricks enablement to the next level by.

article thumbnail

The Cloud Development Environment Adoption Report

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.