Mon.Dec 18, 2023

article thumbnail

Mentoring software engineers or engineering leaders

The Pragmatic Engineer

I get asked every now and then if I offer 1:1 mentoring for either software engineers or engineering managers or leaders. While I used to do this in the past, I don't offer this any more. I collected much of the advice I have to offer for software engineers in The Software Engineer's Guidebook. I also write The Pragmatic Engineer Newsletter where I do cover topics like what it means to be a senior engineer at various companies , how to deal with a low-quality engineering culture , and

article thumbnail

Unlocking the Power of Containers: Exploring the Top 20 Docker Containers for Every Development Need

Analytics Vidhya

Introduction Docker containers have emerged as indispensable tools in the fast-evolving landscape of software development and deployment, providing a lightweight and efficient way to package, distribute, and run applications. This article delves into the top 20 Docker containers across various categories, showcasing their features, use cases, and contributions to streamlining development workflows.

178
178
article thumbnail

Free Harvard Course: Introduction to AI with Python

KDnuggets

Looking for a great course to learn Artificial Intelligence with Python? Check out this free course from Harvard University.

Python 152
article thumbnail

Snowflake Announces Agreement to Acquire Samooha to Simplify Building Interoperable Data Clean Rooms in the Data Cloud

Snowflake

When businesses share sensitive first-party data with outside partners or customers, they must do so in a way that meets strict governance requirements around security and privacy. Data clean rooms have emerged as the technology to meet this need, enabling interoperability where multiple parties can collaborate on and analyze sensitive data in a governed way without exposing direct access to the underlying data and business logic.

Cloud 120
article thumbnail

Apache Airflow® Best Practices for ETL and ELT Pipelines

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

article thumbnail

5 Use Cases of DALLE-3

KDnuggets

Learn how you can use DALL-E 3 to make your life a little bit easier (or a lot).

137
137
article thumbnail

Predict & Analyze marketing campaign effectiveness with SAP Datasphere and Databricks Data Intelligence Platform

databricks

An effective campaign can help improve a company's revenue by increasing the sales of its products, clearing out more stock, bringing in more.

Data 103

More Trending

article thumbnail

Data Engineering Weekly #153

Data Engineering Weekly

RudderStack is the Warehouse Native CDP, built to help data teams deliver value across the entire data activation lifecycle, from collection to unification and activation. Visit rudderstack.com to learn more. Lorin Hochstein: “Human error” means they don’t understand how the system worked The post is not directly related to Data Engineering but system operations in general.

article thumbnail

Best of 2023: Top 5 Customer Engagement Blog Posts

Precisely

By connecting with customers when, where and how they desire, using personalized and data-driven insights, businesses are creating the game-changing experiences that customers demand. Join us as we count down the Top 5 Customer Engagement blog posts of 2023. #5. Managing the Customer Communications Lifecycle Why do customers choose your brand over the competition?

article thumbnail

Simplify and Accelerate Your Data Streaming Workloads With an Intuitive User Experience

Confluent

Confluent’s cloud data streaming platform introduces new features to accelerate workloads: Message Browser, Resource Management Access, and Global Search Optimization.

Cloud 59
article thumbnail

Connecting DBeaver to PostgreSQL via JDBC Driver

Hevo

PostgreSQL is an open-source Relational Database taking the world by storm, both on the ground and up there in the Cloud. It is one of the most advanced Relational Databases offering standard SQL features along with some modern ones like triggers, transaction integrity, etc.

article thumbnail

Apache Airflow®: The Ultimate Guide to DAG Writing

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

article thumbnail

Most Common Use Cases of Data Engineering in Manufacturing

phData: Data Engineering

Data engineering refers to the design of systems that are capable of collecting, analyzing, and storing data at a large scale. In manufacturing, data engineering aids in optimizing operations and enhancing productivity while ensuring curated data that is both compliant and high in integrity. The increased efficiency in data “wrangling” means that more accurate modeling and planning may be done, enabling manufacturers to make stronger data-driven decisions.

article thumbnail

Using modules for Testcontainers with Golang

Zalando Engineering

Introduction Testcontainers for Go enables developers to run easily tests against containerized dependencies. In our previous articles, you can find an introduction of Integration tests with Testcontainers and explore how to write Functional tests with Testcontainers (in Java). This blog post will deep dive into how to use modules and a common issue for Testcontainers with Golang.

Java 45
article thumbnail

Data Observability Trends for 2024 | Acceldata

Acceldata

Acceldata's CEO and co-founder, Rohit Choudhary, explains how data observability will impact enterprises in all fields in the coming year.

Data 40
article thumbnail

Manual Testing Vs Automation Testing: Which One Should You Choose?

Edureka

Software testing is a crucial phase in the software development life cycle as it guarantees that the software operates as intended. The distinctions between Manual Testing Vs Automation Testing will be covered in this blog. Automating a process allows it to follow predetermined steps precisely and mechanically. Similar to an agile artist, manual testing depends on human intuition and exploration to adjust to the unexpected details of software behavior.

article thumbnail

Optimizing The Modern Developer Experience with Coder

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

article thumbnail

Empowering Innovation Responsibly: AI-Focused Data Leaders to Watch in 2024

Snowflake

With the race to incorporate AI, and now gen AI, into their business technology toolboxes, data leaders find themselves faced with new opportunities—and challenges. Some CDOs have embraced the added responsibility with new letters in their acronyms, becoming CDAIOs. With or without a new title, most have been tasked with driving AI innovation within their organizations while mitigating risks to reputation and revenues.

article thumbnail

 Empowering Innovation Responsibly: AI-Focused Data Leaders to Watch in 2024

Snowflake

With the race to incorporate AI, and now gen AI, into their business technology toolboxes, data leaders find themselves faced with new opportunities—and challenges. Some CDOs have embraced the added responsibility with new letters in their acronyms, becoming CDAIOs. With or without a new title, most have been tasked with driving AI innovation within their organizations while mitigating risks to reputation and revenues.

article thumbnail

ML-Based Forecasting and Anomaly Detection in Snowflake Cortex, Now in GA

Snowflake

Historically, only a few AI experts within an organization could develop insights using machine learning (ML) and predictive analytics. Yet in this new wave of AI, democratizing ML to more data teams is crucial—and for Snowflake SQL users, it’s now a reality. With the general availability of ML-based forecasting and anomaly detection functions in Snowflake Cortex, data analysts and other SQL users can now build more accurate forecasts and identify outliers for their time-series data in Snowflake

SQL 97