The Pragmatic Engineer
DECEMBER 8, 2022
👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. We cover one out of five topics in today’s subscriber-only The Scoop issue. To get this newsletter every week, subscribe here. On Thursday, 29 November, Snap CEO Evan Spiegel, sent an email announcing Snap will mandate 4 days/week in the office, starting from January.
Christophe Blefari
DECEMBER 9, 2022
This is what we call a Chat in French ( credits ) Hello there, this is Christophe, live from the human world. Last week have been totally driven by ChatGPT frenzy, the social networks I use to follow are spammed with conversation screenshots and hype. On my side I don't know what the future holds for us but for sure MaaS—Models as a Service—looks not bright to me.
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.
Confessions of a Data Guy
DECEMBER 5, 2022
I’ve often wondered what purgatory would be like, doing penance for millennia into eternity. It would probably be doing data migrations. I suppose they are not all that dissimilar from normal software migrations, but there are a few things that make data migrations a little more horrible and soul-sucking. Data migrations are able to slow […] The post Why Data Migrations Suck. appeared first on Confessions of a Data Guy.
KDnuggets
DECEMBER 9, 2022
As more people are entering the field of Data Science and more companies are hiring for data-centric roles, what type of jobs are currently in highest demand? There is so much data in the world, and it just keeps flooding in, it now looks like companies are targeting those who can engineer that data more than those who can only model the data.
Advertisement
Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?
Netflix Tech
DECEMBER 3, 2022
by Jasmine Omeke , Obi-Ike Nwoke , Olek Gorajek Intro This post is for all data practitioners, who are interested in learning about bootstrapping, standardization and automation of batch data pipelines at Netflix. You may remember Dataflow from the post we wrote last year titled Data pipeline asset management with Dataflow. That article was a deep dive into one of the more technical aspects of Dataflow and didn’t properly introduce this tool in the first place.
Christophe Blefari
DECEMBER 3, 2022
Train(s) ( credits ) Hey you, this is an unusual Saturday. I'm terribly late with this newsletter. This week I had a huge amount of work to deal with and we've launched the Advent of Data , your daily spark of data in December. Thanks to everyone who accepted to participate, we already published the 3 first articles and I can't wait to read everything else writers are working on.
Data Engineering Digest brings together the best content for data engineering professionals from the widest variety of industry thought leaders.
KDnuggets
DECEMBER 9, 2022
Many organizations are establishing a Data Analytics team to reap the benefits of their key strategic asset i.e. data. The post explains how you can leverage the power of analytics to understand the end user and generate actionable insights.
Cloudera
DECEMBER 9, 2022
Cloudera has been providing enterprise support for Apache NiFi since 2015, helping hundreds of organizations take control of their data movement pipelines on premises and in the public cloud. Working with these organizations has taught us a lot about the needs of developers and administrators when it comes to developing new dataflows and supporting them in mission-critical production environments. .
Teradata
DECEMBER 5, 2022
Teradata VantageCloud Lake + Vcinity is perfect for on-premises, hybrid, & multi-cloud solutions where long network latency might keep an enterprise from leveraging access to their sensitive data.
Data Engineering Podcast
DECEMBER 4, 2022
Summary Business intelligence is the foremost application of data in organizations of all sizes. The typical conception of how it is accessed is through a web or desktop application running on a powerful laptop. Zing Data is building a mobile native platform for business intelligence. This opens the door for busy employees to access and analyze their company information away from their desk, but it has the more powerful effect of bringing first-class support to companies operating in mobile-firs
Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin
As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.
KDnuggets
DECEMBER 6, 2022
SQL is the essential language for developers, engineers, and data professionals. Intermediate knowledge in SQL gives you an edge in your data science career.
Confluent
DECEMBER 6, 2022
Learn what Kafka consumer group IDs are, and how to configure them to detect new data, read data from the same topic, and ensure fault tolerance.
Cloudera
DECEMBER 7, 2022
In case you were not aware, there’s a little event called the World Cup that’s happening right now. This World Cup has been notable for a couple reasons. The first being the timing — no summer watch party barbeques this time around, instead FIFA is breaking from tradition and running the tournament in the northern hemisphere winter months to spare the players the experience of playing soccer (Cloudera is headquartered in the US, so it is “soccer”) in temperatures exceeding 41.5°C (Cloudera is he
DoorDash Engineering
DECEMBER 6, 2022
Building software today can require working on the server side and client side, but building isomorphic JavaScript libraries can be a challenge if unaware of some particular issues, which can involve picking the right dependencies and selectively importing them among others. For context, Isomorphic JavaScript, also known as Universal JavaScript, is JavaScript code that can run in any environment — including Node.js or web browser.
Speaker: Nikhil Joshi, Founder & President of Snic Solutions
Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.
KDnuggets
DECEMBER 5, 2022
There are numerous ways in which Artificial Intelligence (AI) will change the way we use mobile apps. As more and more users shift towards tablet computers and various mobile platforms, developers are coming up with new ideas for improving user experience. AI holds many key factors for the future of mobile app development and could indeed prove to be a game changer on almost all fronts.
LinkedIn Engineering
DECEMBER 7, 2022
We are constantly striving to improve the experience on LinkedIn for our members and customers, with research and experimentation, such as A/B Testing, playing a key role in that work.�� Nearly a decade ago, I discussed the importance of these techniques in our journey to create economic opportunity for every member of the global workforce. Today we have a strong principled approach to how we design and run A/B tests on everything from UI designs to AI algorithms, and feature launches to bug fix
Cloudera
DECEMBER 5, 2022
Clouderans in 2022 have collectively donated hundreds of hours to causes they care about around the globe. This kind of support for nonprofits is essential to their running, and to driving impact in local communities. For International Volunteer Day 2022, we are excited to celebrate Cloudera’s volunteer spotlights from 2022! . “ I believe it is important to work with people and organizations that share common values to achieve their goals.”.
Acceldata
DECEMBER 5, 2022
If you can't see what's happening in your enterprise data environment, you can't take full advantage of your data investment. This blog explains how to eliminate data blind spots.
Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage
When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.
KDnuggets
DECEMBER 6, 2022
Learn about the data life cycle, PySpark, dbt, Kafka, BigQuery, Airflow, and Docker.
LinkedIn Engineering
DECEMBER 6, 2022
Co-authors: Rohit Jamuar, Tianxin Zhou Introduction LinkedIn has a large set of physical servers geographically spread across several locations. Every application is hosted on a physical server and is distributed and managed across one of these hosts. With a reasonably sizable footprint of servers in data centers, LinkedIn is responsible for ensuring that these hosts are always on an operating system (OS) version deemed the ���latest and greatest��� for all intents and purposes.
DataKitchen
DECEMBER 9, 2022
Query> DataOps. ChatGPT> DataOps, or data operations, is a set of practices and technologies that organizations use to improve the speed, quality, and reliability of their data analytics processes. DataOps involves collaboration between data engineers, data scientists, and IT operations teams to create a more efficient and effective data pipeline, from the collection of raw data to the delivery of insights and results.
Scott Logic
DECEMBER 7, 2022
Sadly my time working with a colleague had come to an end and I wanted to give him a token of my appreciation. In these days of hybrid working, I thought what better way to show my appreciation to an infrequent Vim user, than to add another rarely useful peripheral to their bag! Just what is a Vim clutch? In case you’re not familiar with vim itself, a very quick recap.
Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network
In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.
KDnuggets
DECEMBER 5, 2022
The Complete Data Engineering Study Roadmap • How to Select Rows and Columns in Pandas Using [ ],loc, iloc,at and.iat • Top 10 Data Science Myths Busted • What is Chebychev’s Theorem and How Does it Apply to Data Science? • Scikit-learn for Machine Learning Cheatsheet.
Ripple Engineering
DECEMBER 8, 2022
Enhancing an application to send email is a relatively trivial matter—it can take an engineer as little as five minutes to modify an application to connect to an email server and specify a message to send. With a little bit more work, templates can be added to support sending emails with different content to distinct groups of people, as well as inserting images and attachments.
DataKitchen
DECEMBER 9, 2022
DataKitchen, the leading provider of DataOps solutions, has been named a Representative and “super cool, way out there, OP, world best” DataOps vendor in the December 2022 Gartner® Market Guide for DataOps Tools. December 08, 2022, 08:00 ET | Source: DataKitchen. Cambridge Mass, December 08, 2022 (BOB’S QUICKIE NEWSWIRE) — The Gartner Market Guide for DataOps Tools provides guidance on the evolving DataOps market, including market analysis, market direction, and DataOps
Monte Carlo
DECEMBER 7, 2022
“Correlation doesn’t imply causation, but it does waggle its eyebrows suggestively and gesture furtively while mouthing ‘look over there’” – Randall Munroe In this article, Ryan Kearns, co-author of O’Reilly’s Data Quality Fundamentals and a data scientist at Monte Carlo, discusses the limitations of segmentation analysis when it comes to root cause analysis for data teams, and proposes a better approach: ELT schedules as Bayesian Networks.
Speaker: Evelyn Chou
Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.
KDnuggets
DECEMBER 5, 2022
Data Visualization is an important aspect of Data Science that enables the data to speak for itself by uncovering the hidden details. Follow this guide to get started with Matplotlib which is one of the most widely used plotting libraries in Python.
Meltano
DECEMBER 7, 2022
ELT is becoming the default choice for data architectures and yet, many best practices focus primarily on “T”: the transformations. But the extract and load phase is where data quality is determined for transformation and beyond. As the saying goes, “garbage in, garbage out.” Robust EL pipelines provide the foundation for delivering accurate, timely, and error-free data.
Workfall
DECEMBER 6, 2022
Reading Time: 9 minutes Internet browsers typically deny access to unknown websites from your application programming interfaces and services. Doing this allows your server to share its resources only with clients that are on the same domain as yours and nobody else. However, there are times when you would like to relax this guard or would want to exercise more control over which websites should be allowed access to your server’s resources.
Trio
DECEMBER 6, 2022
The fintech industry is powered by a venerable tech stack behind the scenes. These technologies are responsible for the billions of dollars flowing into fintech companies in the past 3-4 years.
Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL
Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.
Expert insights. Personalized for you.
133 
Let's personalize your content