Data Engineering Podcast

JANUARY 15, 2023

At the Modern Data Company they created the DataOS platform as a means of driving your full analytics lifecycle through code, while providing automatic knowledge graphs and data discovery. Go to dataengineeringpodcast.com/materialize today and sign up for early access to get started. Struggling with broken pipelines? Stale dashboards?

Coding 130

Coding Building PostgreSQL Data Lake 130

The Pragmatic Engineer

NOVEMBER 21, 2023

Backend code I wrote and pushed to prod took down Amazon.com for several hours. and hand-rolled C -code. To update code, we flipped a symlink ( a symbolic link is a file whose purpose is to point to a file or directory ) to swap between the code and HTML files contained in these directories.

Engineering 302

Engineering Bytes Cloud Computing AWS 302

The Pragmatic Engineer

MARCH 19, 2024

Today, full subscribers got access to a comprehensive Senior-and-above tech compensation research. The company says: “Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork.

Software Engineer 276

Software Engineer Software Engineering Programming Language Media 276

Knowledge Hut

OCTOBER 29, 2023

Source Code: Hospital Management System 2. In addition, you will also need to be familiar with the various APIs that are available for accessing weather data. Source Code: Weather Forecast App 3. Source Code: News Feed App 4. Source Code: OCR System 5. Source Code: Library Management System 6.

Computer Science 111

Computer Science Coding Project Hospitality 111

Data Engineering Podcast

FEBRUARY 18, 2024

As a listener to the Data Engineering Podcast you can get a special discount of 20% off your ticket by using the promo code dataengpod20. What are the differences in terms of pipeline design/access and usage patterns when using a Trino/Iceberg lakehouse as compared to other popular warehouse/lakehouse structures?

Data Lake 262

Data Lake High Quality Data Data Warehouse Google Cloud 262

The Pragmatic Engineer

MARCH 12, 2024

” They write the specification, code, tests it, and write the documentation. Code reviews reduce the need to pair while working on a task, allowing engineers to keep up with changes and learn from each other. CI/CD : running automated tests on all changes, and deploying code to production automatically. The copilot.

Engineering 274

Engineering Programming Language Hospitality Programming 274

Knowledge Hut

MAY 3, 2024

Any coding interview is a test that primarily focuses on your technical skills and algorithm knowledge. The type of interview you might face can be a remote coding challenge, a whiteboard challenge or a full day on-site interview. So, if you can prove your coding skills learnt in your python programming classes in the interview.

Python 98

Python Coding Data Programming 98

The Pragmatic Engineer

SEPTEMBER 26, 2023

Every day, there’s more code at a tech company, not less. However, monorepos result in codebases growing large, so that even checking out the code or updating to the head can be time consuming. Concern about code leaks. With full-remote work, the risk is higher that someone other than the employee accesses the codebase.

Cloud 258

Cloud Software Engineer Software Engineering Cloud Computing 258

Engineering at Meta

DECEMBER 19, 2024

Were sharing details about Glean , Metas open source system for collecting, deriving and working with facts about source code. In August 2021 we open-sourced our code indexing system Glean. Glean collects information about source code and provides it to developer tools through an efficient and flexible query language.

Coding 55

Coding Programming Language SQL Programming 55

Marc Lamberti

SEPTEMBER 22, 2023

To access XComs, go to the user interface, then Admin and XComs. and put the code in it. With just one line of code, you’ve pushed your first XComs! To know which one, you have to look into the code but there is one parameter that operators have in common: do_xcom_push. How to use XCom in Airflow? Time to practice.

MySQL 246

MySQL Data Pipeline Database Python 246

Snowflake

JUNE 5, 2024

It provides access to industry-leading large language models (LLMs), enabling users to easily build and deploy AI-powered applications. By using Cortex, enterprises can bring AI directly to the governed data to quickly extend access and governance policies to the models. Fine-tuned models can be managed using Snowflake Model Registry.

Coding 93

Coding Building Management Government 93

Analytics Vidhya

FEBRUARY 2, 2023

Introduction SQL injection is an attack in which a malicious user can insert arbitrary SQL code into a web application’s query, allowing them to gain unauthorized access to a database. We can use this to steal sensitive information or make unauthorized changes to the data stored in the database.

Database 204

Database SQL Coding Accessible 204

The Pragmatic Engineer

OCTOBER 10, 2024

What makes Wordpress popular is a mix of factors: Restrictive license : licensed as  GPLv2 , which allows for commercial use, and for modifying the code; as long as the license remains in place.   Forks gaining momentum that has the code of Wordpress, but uses a different name could also be in the books. 25 Sep: Block.

Consulting 306

Consulting AWS Engineering Software Engineer 306

The Pragmatic Engineer

OCTOBER 17, 2024

The startup was able to start operations thanks to getting access to an EU grant called NGI Search grant. Code and raw data repository:   Version control: GitHub Heavily using GitHub Actions for things like getting warehouse data from vendor APIs, starting cloud servers, running benchmarks, processing results, and cleaning up after tuns.

Cloud 278

Cloud AWS Metadata Cloud Computing 278

The Pragmatic Engineer

MAY 1, 2024

The company says: “Devin is the new state-of-the-art on the SWE-Bench coding benchmark, has successfully passed practical engineering interviews from leading AI companies, and has even completed real jobs on Upwork. Source: Cognition So far, all we have is video demos, and accounts of those with access to this tool.

Software Engineer 200

Software Engineer Software Engineering Programming Language Media 200

KDnuggets

OCTOBER 30, 2024

Each project, from beginner tasks like Image Classification to advanced ones like Anomaly Detection, includes a link to the dataset and source code for easy access and implementation.

Project 153

Project Datasets Coding Accessible 153

The Pragmatic Engineer

SEPTEMBER 19, 2024

Use tech debt payments to get into the flow and stay in it A good reason to add new comments to old code before you change it is to speed up a code review. When it takes me time to learn what code does, writing something down helps me remember what I figured out. Clarifying the code is even better.

Recruitment 176

Recruitment Java Coding Project 176

The Pragmatic Engineer

OCTOBER 10, 2023

However, Martin had not written a line of production code for the last four years, as he’s taken on the role of CEO, and heads up observability scaleup Chronosphere – at more than 250 people and growing. From learning to code in Australia, to working in Silicon Valley How did I learn to code?

Software Engineer 268

Software Engineer Software Engineering Architecture Media 268

The Pragmatic Engineer

OCTOBER 18, 2024

  Modify the code so it removed ways to upgrade from free to paid Spotify features in this free app. Blocked from WordPress.com : even though WP Engine lawsuit is against Automattic and its CEO, WordPress.org bans anyone affiliated with WP Engine from accessing the site and updating plugins.

Engineering 326

Engineering Government Project AWS 326

KDnuggets

OCTOBER 15, 2024

Explore free platforms for learning, building portfolios, accessing code editors, engaging with communities, and hosting projects.

Data Science 141

Data Science Portfolio Coding Accessible 141

Data Engineering Podcast

MAY 12, 2024

The services and systems need to be kept up to date, but so does the code that controls their behavior. Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is supported by Code Comments, an original podcast from Red Hat. Data lakes are notoriously complex.

Management 147

Management Data Lake High Quality Data Machine Learning 147

KDnuggets

SEPTEMBER 11, 2024

Access a pre-built Python environment with free GPUs, persistent storage, and large RAM. These Cloud IDEs include AI code assistants and numerous plugins for a fast and efficient development experience.

Cloud 139

Cloud Data Science Python Coding 139

Snowflake

APRIL 24, 2024

Members of the Snowflake AI Research team pioneered systems such as ZeRO and DeepSpeed , PagedAttention / vLLM , and LLM360 which significantly reduced the cost of LLM training and inference, and open sourced them to make LLMs more accessible and cost-effective for the community. license provides ungated access to weights and code.

Amazon Web Services 145

Amazon Web Services SQL AWS Architecture 145

Robinhood

MAY 30, 2024

Robinhood Crypto has continued to see its market share increase as customers get access to a growing number of advanced trading tools to help them efficiently navigate the crypto market.” Our Security Team routinely reviews code and infrastructure powering Robinhood Crypto. This gives customers an additional layer of protection.

Insurance 142

Insurance Portfolio Algorithm Coding 142

Data Engineering Podcast

MAY 26, 2024

This episode is supported by Code Comments, an original podcast from Red Hat. In Code Comments, host Jamie Parker, Red Hatter and experienced engineer, shares the journey of technologists from across the industry and their hard-won lessons in implementing new technologies. My thanks to the team at Code Comments for their support.

Systems 130

Systems Data Lake High Quality Data Google Cloud 130

Data Engineering Podcast

JUNE 9, 2024

Announcements Hello and welcome to the Data Engineering Podcast, the show about modern data management This episode is supported by Code Comments, an original podcast from Red Hat. Search for "Code Commentst" in your podcast player or go to dataengineeringpodcast.com/codecomments today to subscribe.

Process 147

Process Data Lake High Quality Data Machine Learning 147

Data Engineering Podcast

JUNE 2, 2024

This episode is supported by Code Comments, an original podcast from Red Hat. In Code Comments, host Jamie Parker, Red Hatter and experienced engineer, shares the journey of technologists from across the industry and their hard-won lessons in implementing new technologies. My thanks to the team at Code Comments for their support.

Data Governance 147

Data Governance Government Data Lake High Quality Data 147

Engineering at Meta

APRIL 13, 2023

To do so, our most security conscious users have always been able to take advantage of our security code verification feature available under a user’s contact info. When in person, keys can be validated with a quick QR code scan or, if remote, sharing the unique 60-digit code. What stops this today?

Utilities 145

Utilities Coding Database Accessible 145

Data Engineering Podcast

MARCH 3, 2024

As a listener to the Data Engineering Podcast you can get a special discount off regular priced and late bird tickets by using the promo code dataengpod20. Visit dataengineeringpodcast.com/data-council and use code dataengpod20 to register today! Promo Code: dataengpod20 Starburst : ![Starburst

Programming 162

Programming Data Lake High Quality Data Data Pipeline 162

Data Engineering Podcast

FEBRUARY 25, 2024

As a listener to the Data Engineering Podcast you can get a special discount off regular priced and late bird tickets by using the promo code dataengpod20. Visit dataengineeringpodcast.com/data-council and use code dataengpod20 to register today! Promo Code: dataengpod20 Dagster : ![Dagster Promo Code: dataengpod20 Dagster : ![Dagster

Database 162

Database Technology Data Lake High Quality Data 162

Start Data Engineering

OCTOBER 14, 2024

Code & Data 3. STRUCT enables more straightforward data schema and data access 3.3.2. Introduction 2. Using nested data types effectively 3.1. Use STRUCT for one-to-one & hierarchical relationships 3.2. Use ARRAY[STRUCT] for one-to-many relationships 3.3. Using nested data types in data processing 3.3.1.

SQL 130

SQL Data Schemas Data Coding 130

Snowflake

SEPTEMBER 7, 2023

We are excited to announce the public preview of External Access, which enables customers to reach external endpoints from Snowpark seamlessly and securely. With this announcement, External Access is in public preview on Amazon Web Services (AWS) regions.

Amazon Web Services 122

Amazon Web Services AWS Government Python 122

Christophe Blefari

MARCH 2, 2024

Using DuckDB + Ibis for RAG — Handy code snippet to explain why DuckDB is a good solution bringing best of both world when it comes to RAG. Snowflake access management — I've already share Teej work in the past, but now he launched a company to solve Snowflake access management, using code.

Data 162

Data Python Database BI 162

The Pragmatic Engineer

JANUARY 5, 2023

But today has been anything but a soft landing for customers of CircleCI, who got the email you always dread from a vendor, suggesting CircleCI was compromised and customers' secrets could have been accessed by an attacker during the past two weeks. Attackers gained access to GitHub accounts of organizations.

Pipeline-centric 130

Pipeline-centric Database-centric Coding Accessible 130

Engineering at Meta

JUNE 27, 2023

A more ergonomic alternative is EdenFS, which checks out everything in a few seconds but then only actually downloads the files from the server when they are accessed. Buck2 can also use specific EdenFS operations to access the file without going via the disk, optimizing performance on systems where virtual file systems can be slower.

Java 133

Java Programming Language Algorithm Programming 133

Tweag

NOVEMBER 20, 2024

A lot of improvements have happened after the initial merge, including but not limited to: Many, many bugfixes in the code generator and runtime, witnessed by the full GHC testsuite for the wasm backend in upstream GHC CI pipelines. Show me the code! $ Now let’s run some code. nix shell gitlab:ghc/ghc-wasm-meta?host

Coding 137

Coding Programming Project Process 137

Engineering at Meta

AUGUST 27, 2024

This approach involves using simple if statements in code (“code assets”) or access control mechanisms for datasets (“data assets”) in data systems. Addressing these risks requires implementing resource-intensive human audits at access points.

Programming Language 122

Programming Language Coding Data Warehouse Systems 122