Sat.Nov 18, 2023 - Fri.Nov 24, 2023

article thumbnail

How LinkedIn Built the Engineering Infrastructure to Ignite Professional Knowledge Sharing

LinkedIn Engineering

Co-Authors: Shweta Patira , Ankan Saha , Yilin Li, and Manas Somaiya Earlier this year, we launched Collaborative Articles with the vision of making LinkedIn the one-stop destination for all work-related questions. Among our 1 billion members, there are seasoned experts who have encountered every conceivable workplace problem. If we could present their thoughts on LinkedIn, then mentors, experts, and coaches would be right at our members' fingertips.

article thumbnail

The Roots of Today's Modern Backend Engineering Practices

The Pragmatic Engineer

👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. In every issue, I cover topics related to Big Tech and startups through the lens of engineering managers and senior engineers. In this article, we cover thee out of nine topics from today’s subscriber-only issue: The Past and Future of Modern Backend Practices.

Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Unlocking Your dbt Projects With Practical Advice For Practitioners

Data Engineering Podcast

Summary The dbt project has become overwhelmingly popular across analytics and data engineering teams. While it is easy to adopt, there are many potential pitfalls. Dustin Dorsey and Cameron Cyr co-authored a practical guide to building your dbt project. In this episode they share their hard-won wisdom about how to build and scale your dbt projects.

Project 147
article thumbnail

Data+AI Summit 2023, retrospective part 1 - streaming

Waitingforcode

Even though you may be thinking now about Data+AI Summit 2024, I still owe you my retrospective for the 2023 edition. Let's start with the first part covering stream processing talks!

Data 130
article thumbnail

15 Modern Use Cases for Enterprise Business Intelligence

Large enterprises face unique challenges in optimizing their Business Intelligence (BI) output due to the sheer scale and complexity of their operations. Unlike smaller organizations, where basic BI features and simple dashboards might suffice, enterprises must manage vast amounts of data from diverse sources. What are the top modern BI use cases for enterprise businesses to help you get a leg up on the competition?

article thumbnail

Tackle computer science problems using both fundamental and modern algorithms in machine learning

KDnuggets

Master algorithms, including deep learning like LSTMs, GRUs, RNNs, and Generative AI & LLMs such as ChatGPT, with Packt's 50 Algorithms Every Programmer Should Know.

Algorithm 144
article thumbnail

Creating a bespoke LLM for AI-generated documentation

databricks

We recently announced our AI-generated documentation feature, which uses large language models (LLMs) to automatically generate documentation for tables and columns in Unity.

More Trending

article thumbnail

Use Data Enrichment to Supercharge AI

Precisely

AI transforms how we interact with technology, make decisions, and solve complex problems. It has been at the heart of many innovations over the past two years, powering everything from the chatbots that enhance our customer experiences to the predictive analytics engines that help us make financial decisions. What defines a successful AI initiative, and how can your organization ensure that your investments and hard work deliver maximum value for your organization?

Raw Data 121
article thumbnail

5 Free Courses to Master Machine Learning

KDnuggets

Are you excited to learn about and build machine learning models? Start learning today with these free machine learning courses.

article thumbnail

Improving Efficiency Of Goku Time Series Database at Pinterest (Part?—?1)

Pinterest Engineering

Improving Efficiency Of Goku Time Series Database at Pinterest (Part — 1) Monil Mukesh Sanghavi, Kapil Bajaj, Ming-May Hu, Xiao Li and Zhenxiao Luo Introduction At Pinterest, one of the pillars of the observability stack provides internal engineering teams (our users) the opportunity to monitor their services using metrics data and set up alerting on it.

Database 108
article thumbnail

Contextual Keyboard Shortcuts in ArcGIS Pro 3.2

ArcGIS

Contextual keyboard shortcuts open up a whole new world of customization possibilities in ArcGIS Pro 3.2.

133
133
article thumbnail

Prepare Now: 2025s Must-Know Trends For Product And Data Leaders

Speaker: Jay Allardyce, Deepak Vittal, and Terrence Sheflin

As we look ahead to 2025, business intelligence and data analytics are set to play pivotal roles in shaping success. Organizations are already starting to face a host of transformative trends as the year comes to a close, including the integration of AI in data analytics, an increased emphasis on real-time data insights, and the growing importance of user experience in BI solutions.

article thumbnail

Product Owner vs. Scrum Master: Key Differences

Knowledge Hut

Product Owners and Scrum Masters are two integral roles in Scrum, an Agile project management methodology. While both roles are essential for successful Scrum teams, their responsibilities are distinct. When talking about Product Owner vs Scrum Master responsibilities, it is necessary to note that the Product Owner looks after the vision and content of the product.

article thumbnail

A Comprehensive List of Resources to Master Large Language Models

KDnuggets

Large Language Models (LLMs) have now become an integral part of various applications. This article provides an extensive list of resources for anyone interested to dive into the world of LLMs.

136
136
article thumbnail

Next-Level Apps with Snowpark Container Services and Snowflake Native Apps

Snowflake

The enterprise app market has been growing faster than ever before, due to the recent spike in demand for AI / ML workloads. These new types of apps operate over large sets of data, have increasingly higher compute demands, require strict data privacy protections, provide very sophisticated web experiences, and need to be secure at all stages of their life cycles.

article thumbnail

LLM finetuning memory requirements by Alex Birch

Scott Logic

If you want to try your hand at fine-tuning an LLM (Large Language Model): one of the first things you’re going to need to know is “will it fit on my GPU”. The pre-eminent guide to estimating (VRAM) memory requirements is Transformer Math 101. It bears mentioning, though, that its heuristics are written in the context of frameworks such as GPT-NeoX and Megatron-DeepSpeed.

Bytes 102
article thumbnail

How to Drive Cost Savings, Efficiency Gains, and Sustainability Wins with MES

Speaker: Nikhil Joshi, Founder & President of Snic Solutions

Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint. Join Nikhil Joshi, Founder & President of Snic Solutions, in this value-packed webinar as he breaks down how MES can drive operational excellence and sustainability.

article thumbnail

How To Optimize Website For Mobile Users

Knowledge Hut

The world is gradually having a paradigm shift from desktop computers to mobile devices- it doesn’t mean that the desktop experience is not good. According to a recent mobile survey , many mobile users have confirmed that it is more appealing, unique, user-friendly and functional. Here are some guides that will help you in learning how to optimise website for mobile users: Choose your site layout You need to ensure your website layout is well streamlined.

Media 98
article thumbnail

Create Stunning Data Viz in Seconds with ChatGPT

KDnuggets

Data scientists love it! See how ChatGPT creates jaw-dropping data viz with just a few words - it's almost unfair how easy it is.

Data 149
article thumbnail

Writing and linting Python at scale

Engineering at Meta

Python plays a big part at Meta. It powers Instagram’s backend and plays an important role in our configuration systems, as well as much of our AI work. Meta even made contributions to Python 3.12 , the latest version of Python. On this episode of the Meta Tech Podcast , Meta engineer Pascal Hartig ( @passy ) is joined by Amethyst Reese, a production engineer at Meta, to discuss all things Python at Meta.

Python 96
article thumbnail

Announcing Enhanced Control Flow in Databricks Workflows

databricks

A key element in orchestrating multi-stage data and AI processes and pipelines is control flow management. This is why we continue to invest.

Process 109
article thumbnail

Improving the Accuracy of Generative AI Systems: A Structured Approach

Speaker: Anindo Banerjea, CTO at Civio & Tony Karrer, CTO at Aggregage

When developing a Gen AI application, one of the most significant challenges is improving accuracy. This can be especially difficult when working with a large data corpus, and as the complexity of the task increases. The number of use cases/corner cases that the system is expected to handle essentially explodes. 💥 Anindo Banerjea is here to showcase his significant experience building AI/ML SaaS applications as he walks us through the current problems his company, Civio, is solving.

article thumbnail

Top Azure Certifications to Skyrocket Your Career in 2023

Knowledge Hut

Over the past few years, there has been a paradigm shift in the world of computing, with cloud computing being on the forefront. It is a computing model based on the internet and it provides on-demand data and shared computer processing to computers and devices. With cloud computing, a pool of computing resources can be shared and accessed. This allows the transfer of information in an effortless manner.

article thumbnail

5 Free Courses to Master Generative AI

KDnuggets

Generative AI is an exciting and fast-moving area of research and application. Check out these 5 courses to get up to speed and stay ahead of the curve.

117
117
article thumbnail

Incremental Processing using Netflix Maestro and Apache Iceberg

Netflix Tech

by Jun He , Yingyi Zhang , and Pawan Dixit Incremental processing is an approach to process new or changed data in workflows. The key advantage is that it only incrementally processes data that are newly added or updated to a dataset, instead of re-processing the complete dataset. This not only reduces the cost of compute resources but also reduces the execution time in a significant manner.

Process 86
article thumbnail

What’s new in ArcGIS Image Analyst November 2023

ArcGIS

The November 2023 release of ArcGIS Image Analyst for ArcGIS Pro brings exciting enhancements to deep learning, image science and SAR.

article thumbnail

The Ultimate Guide To Data-Driven Construction: Optimize Projects, Reduce Risks, & Boost Innovation

Speaker: Donna Laquidara-Carr, PhD, LEED AP, Industry Insights Research Director at Dodge Construction Network

In today’s construction market, owners, construction managers, and contractors must navigate increasing challenges, from cost management to project delays. Fortunately, digital tools now offer valuable insights to help mitigate these risks. However, the sheer volume of tools and the complexity of leveraging their data effectively can be daunting. That’s where data-driven construction comes in.

article thumbnail

How Much Does a PgMP Certification Cost?

Knowledge Hut

The PgMP (Program Management Professional) certification acknowledges advanced expertise, proficiency, and accomplishments in orchestrating multiple interconnected projects and their resources in alignment with organizational objectives. As we progress in our project management careers, our hands-on experience overseeing many interrelated projects and making strategic decisions that drive business objectives exemplifies our adeptness.

article thumbnail

How To Write Efficient Python Code: A Tutorial for Beginners

KDnuggets

Are you a programmer looking to get better at Python? Learn some of Python’s features that’ll help you write more elegant and Pythonic code.

Python 124
article thumbnail

Migrating From Elasticsearch 7.17 to Elasticsearch 8.x: Pitfalls and Learnings

Zalando Engineering

What this article is about What kind of changes we had to make to the codebase How we did the actual upgrade What challenges we faced How we did the data transfer How the data was kept in sync What this article is not A step-by-step guide on how to upgrade Elasticsearch (read on to find out why). Who we are We are a team from the Search & Browse department, the department in Zalando that is responsible for all things search (read: relevance, personalisation, sorting, filters, full text searc

Scala 82
article thumbnail

Unwrapping the secrets of a data + AI career

databricks

Upskilling through role-based pathways to accelerate your data + AI career Databricks has spent years crafting and iterating technical trainings for learners across.

Data 87
article thumbnail

Business Intelligence 101: How To Make The Best Solution Decision For Your Organization

Speaker: Evelyn Chou

Choosing the right business intelligence (BI) platform can feel like navigating a maze of features, promises, and technical jargon. With so many options available, how can you ensure you’re making the right decision for your organization’s unique needs? 🤔 This webinar brings together expert insights to break down the complexities of BI solution vetting.

article thumbnail

DevOps Lifecycle: Definition, Phases

Knowledge Hut

DevOps is an approach to software development that emphasizes collaboration and communication between software developers, IT professionals, and business stakeholders. It aims to reduce the time, cost, and risk of software development while improving the quality of the final products. DevOps is not just a technical concept. It's also a way of thinking about software development and operations holistically.

article thumbnail

Hardware-Accelerated AI for Windows Apps Using ONNX RT

KDnuggets

The Qualcomm AI Stack now supports ONNX RT and allows for hardware-accelerated AI in Windows on Snapdragon apps. Windows on Snapdragon is the next generation Windows platform, built on years of evolution in mobile compute.

105
105
article thumbnail

The Power of MQTT and Confluent in Fleet Management

Confluent

MQTT and Confluent work together to stream and process IoT device data in real time, powering fleet management systems. Learn how here.

article thumbnail

Guest Post: Real-Time Fraud Detection in the Lakehouse

databricks

The costs of fraud are staggering. In 2022, just one type of fraud, card-not-present fraud, resulted in almost $6bn in losses in the.

97
article thumbnail

Driving Responsible Innovation: How to Navigate AI Governance & Data Privacy

Speaker: Aindra Misra, Senior Manager, Product Management (Data, ML, and Cloud Infrastructure) at BILL

Join us for an insightful webinar that explores the critical intersection of data privacy and AI governance. In today’s rapidly evolving tech landscape, building robust governance frameworks is essential to fostering innovation while staying compliant with regulations. Our expert speaker, Aindra Misra, will guide you through best practices for ensuring data protection while leveraging AI capabilities.