KDnuggets

AUGUST 16, 2019

As a data scientist, you are in high demand. So, how can you increase your marketability even more? Check out these current trends in skills most desired by employers in 2019.

Data 123

Data Data Science 123

Confluent

AUGUST 15, 2019

With the release of Apache Kafka ® 2.3 and Confluent Platform 5.3 came several substantial improvements to the already awesome Kafka Connect. Not sure what Kafka Connect is or need convincing of its awesomeness? Didn’t realise that it’s part of Apache Kafka and solves all your streaming integration needs? Check out my Kafka Summit London talk: From Zero to Hero with Kafka Connect —and if you want to hear more talks like this, be sure to come to Kafka Summit San Francisco.

Kafka 21

Kafka Hadoop Architecture Engineering 21

Data Engineering Podcast

AUGUST 12, 2019

Summary The extract and load pattern of data replication is the most commonly needed process in data engineering workflows. Because of the myriad sources and destinations that are available, it is also among the most difficult tasks that we encounter. Fivetran is a platform that does the hard work for you and replicates information from your source systems into whichever data warehouse you use.

Media 100

Media Data Warehouse Data Big Data 100

Uber Engineering

AUGUST 14, 2019

Maintaining Uber’s large-scale data warehouse comes with an operational cost in terms of ETL functions and storage. In our experience, optimizing for operational efficiency requires answering one key question: for which tables does the maintenance cost supersede utility? Once identified, … The post Less is More: Engineering Data Warehouse Efficiency with Minimalist Design appeared first on Uber Engineering Blog.

Data Warehouse 96

Data Warehouse Designing Engineering Utilities 96

Advertisement

Whether you’re creating complex dashboards or fine-tuning large language models, your data must be extracted, transformed, and loaded. ETL and ELT pipelines form the foundation of any data product, and Airflow is the open-source data orchestrator specifically designed for moving and transforming data in ETL and ELT pipelines. This eBook covers: An overview of ETL vs.

Architecture

KDnuggets

AUGUST 16, 2019

Use of Machine Learning (ML) in Medicine is becoming more and more important. One application example can be Cancer Detection and Analysis.

Machine Learning 123

Machine Learning Medical Healthcare 123

Confluent

AUGUST 13, 2019

Yes, the other definition of event sourcing. 1. Keynotes from leading technologists. At Kafka Summit SF, you’ll get to hear incredible keynotes from leading technologists, including Jay Kreps and Neha Narkhede , original co-creators of Apache Kafka ®. In the past, we’ve featured Chris D’Agostino, James Watters, Martin Kleppmann, and Martin Fowler. This time around, we’re delighted to have Devendra Tagare , Engineering Manager of Streaming Platforms from Lyft and Chris Kasten , VP of Walmart Clou

Kafka 19

Kafka Food Electronics Recruitment 19

Rockset

AUGUST 16, 2019

Have you ever felt uncertain parking in a shady area? In particular, have you ever parked in San Francisco and wondered, if I measured the average inverse square distance to every vehicle incident recorded by the SFPD in the last year, at what percentile would my current location fall? If so, we built an app for that. In this post we’ll explain our methodology and its implementation.

Datasets 40

Datasets AWS Data SQL 40

KDnuggets

AUGUST 14, 2019

At times it may seem Machine Learning can be done these days without a sound statistical background but those people are not really understanding the different nuances. Code written to make it easier does not negate the need for an in-depth understanding of the problem.

Machine Learning 123

Machine Learning Coding IT Data Science 123

Confluent

AUGUST 14, 2019

Compliance requirements often dictate that services should not store secrets as cleartext in files. These secrets may include passwords, such as the values for ssl.key.password , ssl.keystore.password , and ssl.truststore.password configuration parameters (as shown below), or any other sensitive data in the configuration files or log files. Here is a snippet from a properties file with standard SSL configurations that users often don’t want in cleartext: security.inter.broker.protocol=SSL

Kafka 13

Kafka Metadata Accessibility Accessible 13

Teradata

AUGUST 13, 2019

Find out how the early architectural decisions surrounding the Teradata Database are still making a critical contribution to performance today. Read more!

Data Management 65

Data Management Management Architecture Database 65

Speaker: Tamara Fingerlin, Developer Advocate

In this new webinar, Tamara Fingerlin, Developer Advocate, will walk you through many Airflow best practices and advanced features that can help you make your pipelines more manageable, adaptive, and robust. She'll focus on how to write best-in-class Airflow DAGs using the latest Airflow features like dynamic task mapping and data-driven scheduling!

Data

Rockset

AUGUST 13, 2019

Organizations speak of operational reporting and analytics as the next technical challenge in improving business processes and efficiency. In a world where everyone is becoming an analyst , live dashboards surface up-to-date insights and operationalize real-time data to provide in-time decision-making support across multiple areas of an organization.

BI 40

BI NoSQL PostgreSQL AWS 40

KDnuggets

AUGUST 12, 2019

Check out this list of NLP researchers, practitioners and innovators you should be following, including academics, practitioners, developers, entrepreneurs, and more.

123

123

KDnuggets

AUGUST 12, 2019

If you are diving into AI and machine learning, Andrew Ng's book is a great place to start. Learn about six important concepts covered to better understand how to use these tools from one of the field's best practitioners and teachers.

Machine Learning 123

Machine Learning 123

KDnuggets

AUGUST 13, 2019

Apache Spark is one of the hottest and largest open source project in data processing framework with rich high-level APIs for the programming languages like Scala, Python, Java and R. It realizes the potential of bringing together both Big Data and machine learning.

Scala 24

Scala Programming Language Java Big Data 24

Advertisement

Many software teams have migrated their testing and production workloads to the cloud, yet development environments often remain tied to outdated local setups, limiting efficiency and growth. This is where Coder comes in. In our 101 Coder webinar, you’ll explore how cloud-based development environments can unlock new levels of productivity. Discover how to transition from local setups to a secure, cloud-powered ecosystem with ease.

Cloud

KDnuggets

AUGUST 15, 2019

Check out this introductory guide to completing simple tasks with the command line.

Data 122

Data Data Science 122

KDnuggets

AUGUST 13, 2019

Creating effective data visualisations is a core skill for data scientists. This tutorial will guide you through how to easily develop interactive visualisations using the Python library plotly.

Python 122

Python Data 122

KDnuggets

AUGUST 14, 2019

Processing unstructured text data in real-time is challenging when applying NLP or NLU. Find out how an alternative, called Domain-Specific Language Processing, can mine valuable information from data by following your guidance and using the language of your business.

Unstructured Data 119

Unstructured Data Process Data 119

KDnuggets

AUGUST 14, 2019

An solid overview of the Poisson distribution, starting from why it is needed, how it stacks up to binomial distribution, deriving its formula mathematically, and more.

IT 117

IT 117

Advertisement

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

Business Intelligence

KDnuggets

AUGUST 15, 2019

Predictor collinearity (also known as multicollinearity) can be problematic for your regression models. Check out these rules of thumb about when, and when not, to be concerned.

IT 116

IT 116

KDnuggets

AUGUST 16, 2019

Here, I will attempt an objective comparison between all three frameworks. This comparison comes from laying out similarities and differences objectively found in tutorials and documentation of all three frameworks.

Python 112

Python 112

KDnuggets

AUGUST 13, 2019

The amount of time I had to put in to organize the AI Society left me sometimes sleep-deprived but it was definitely worth it. It was also one of the main factors why I got the job in Machine Learning after all. I hope that this article will inspire you to create your own AI study group!

Machine Learning 110

Machine Learning IT Education 110

KDnuggets

AUGUST 12, 2019

Semantic segmentation refers to the process of linking each pixel in an image to a class label. These labels could include a person, car, flower, piece of furniture, etc., just to mention a few. We’ll now look at a number of research papers on covering state-of-the-art approaches to building semantic segmentation models.

Building 105

Building Process Python 105

Speaker: Jay Allardyce, Deepak Vittal, Terrence Sheflin, and Mahyar Ghasemali

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

Data

KDnuggets

AUGUST 14, 2019

Also: Top 13 Skills To Become a Rockstar Data Scientist, Top 10 Data Science Leaders You Should Follow; What's wrong with the approach to Data Science?

Big Data 91

Big Data Data Science Cloud Data 91

KDnuggets

AUGUST 15, 2019

The positions require research and teaching expertise in AI/Data Science, or related areas including Data Extraction, Data Visualization, Machine Learning, and Intelligent Actuators.

Data Science 85

Data Science Machine Learning Data 85

KDnuggets

AUGUST 15, 2019

While the process of building simple, domain-specific chatbots has gotten way easier, building large scale, multi-agent conversational applications remains a massive challenge. Recently, the Uber engineering team open sourced the Plato Research Dialogue System, which is the framework powering conversational agents across Uber’s different applications.

Systems 84

Systems Building Engineering Process 84

KDnuggets

AUGUST 15, 2019

The lineup of experienced, thought-leading speakers at Data Driven Government, Sep 25 in Washington, DC, will explain how to use data and analytics to more effectively accomplish your mission, increase efficiency, and improve evidence-based policymaking.

Government 83

Government Data 83

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

Manufacturing

KDnuggets

AUGUST 13, 2019

Help develop new e-science methods that fundamentally integrates Deep Learning and Multivariate analysis. The postdoc position is full-time for a period of two years.

Deep Learning 82

Deep Learning 82

KDnuggets

AUGUST 14, 2019

Deep Learning Cheat Sheets; 12 NLP Researchers, Practitioners & Innovators You Should Be Following; Knowing Your Neighbours: Machine Learning on Graphs.

Deep Learning 79

Deep Learning Machine Learning 79

KDnuggets

AUGUST 12, 2019

Chris Wylie, the whistleblower who exposed Cambridge Analytica, will headline Big Data LDN 2019 programme, along with over 100 speakers at this free to attend event, Nov 13-14, London.

Big Data 78

Big Data Data 78

KDnuggets

AUGUST 13, 2019

Umea University, Sweden is seeking a PhD-student in computational science with focus on chemistry. The position is for 4 years of research including courses on graduate level.

Computer Science 78

Computer Science Machine Learning 78

Advertisement

Cloud Development Environments (CDEs) are changing how software teams work by moving development to the cloud. Our Cloud Development Environment Adoption Report gathers insights from 223 developers and business leaders, uncovering key trends in CDE adoption. With 66% of large organizations already using CDEs, these platforms are quickly becoming essential to modern development practices.

Cloud