This site uses cookies to improve your experience. To help us insure we adhere to various privacy regulations, please select your country/region of residence. If you do not select a country, we will assume you are from the United States. Select your Cookie Settings or view our Privacy Policy and Terms of Use.
Cookie Settings
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Used for the proper function of the website
Used for monitoring website traffic and interactions
Cookie Settings
Cookies and similar technologies are used on this website for proper function of the website, for tracking performance analytics and for marketing purposes. We and some of our third-party providers may use cookie data for various purposes. Please review the cookie settings below and choose your preference.
Strictly Necessary: Used for the proper function of the website
Performance/Analytics: Used for monitoring website traffic and interactions
If you work in data, then youve likely used BigQuery and youve likely used it without really thinking about how it operates under the hood. On the surface BigQuery is Google Clouds fully-managed, serverless data warehouse. Its the Redshift of GCP except we like it a little more. The question becomes, how does it work?…
The below article was originally published in The Pragmatic Engineer , on 29 February 2024. I am re-publishing it 6 months later as a free-to-read article. This is because the below case is a good example on hype versus reality with GenAI. To get timely analysis like this in your inbox, subscribe to The Pragmatic Engineer. I signed up to try it out.
Because they can preserve the visual layout of documents and are compatible with a wide range of devices and operating systems, PDFs are used for everything from business forms and educational material to creative designs.
Recently, I’ve encountered a few projects that used AWS DMS, which is almost like an ELT solution. Whether it was moving data from a local database instance to S3 or some other data storage layer. It was interesting to see AWS DMS used in this manner. But it’s not what DMS was built for.
Speaker: Andrew Skoog, Founder of MachinistX & President of Hexis Representatives
Smart automation and AI-driven software are revolutionizing decision-making, optimizing processes, and improving efficiency. But how do you implement these tools with confidence and ensure they complement human expertise rather than override it?
Apps created through the Startup Accelerator program benefit from the ease, efficiency, scale and performance of Snowflakes platform for accelerated time to market, improved operational efficiency and a more seamless customer experience. We believe this collaboration will foster a new wave of data-driven innovation."
Key Takeaways: Centralized visibility of data is key. Modern IT environments require comprehensive data for successful AIOps, that includes incorporating data from legacy systems like IBM i and IBM Z into ITOps platforms. Predictive of AIOps capabilities will revolutionize IT operations. Scalable solutions are key for future-ready IT operations.
As businesses evolve and delivery speeds increase, IT operations teams face environments where downtime isn’t an option. The traditional ways of operations management are over modernization and holistic approaches are now essential. For IT operations (ITOps) teams, 2025 means reassessing technology stacks, processes, and people. Whats next?
Early enterprise adopters of generative AI have made it clear that a robust data strategy is the cornerstone of any successful AI initiative. To truly unlock AI's potential as a value multiplier and catalyst for reimagined customer experiences, an easy-to-use and trusted data platform is indispensable.
Speaker: Nikhil Joshi, Founder & President of Snic Solutions
Is your manufacturing operation reaching its efficiency potential? A Manufacturing Execution System (MES) could be the game-changer, helping you reduce waste, cut costs, and lower your carbon footprint.
Data source: this Gist StackOverflow has not seen so few questions asked monthly since 2009! The graph shows the steep drop-off in usage accelerated with the launch of OpenAi’s chatbot, and It’s easy enough to figure out why: LLMs are the fastest and most efficient at helping developers to get “unstuck” with coding.
Imagine Apple decided Spotify was a big enough business threat that it had to take unfair measures to limit Spotify’s growth on the App Store. Now imagine that Spotify sued Apple for these unfair practices. Modify the code so it removed ways to upgrade from free to paid Spotify features in this free app.
Automattic generates most of its revenue by offering managed Wordpress hosting. In the other corner: WP Engine. A A company that raised $250M of funding from Silver lake Partners in 2018. The same Silver Lake purchased a majority stake in Skype for $1.9B in 2009, and sold the company for $8.5B 25 Sep: Hit back. Automattic
Some personal news: I will be in Amsterdam for the DuckCon on Jan 31, I'll give a 5 minutes talk about yato , if you're also going or living there, reach out so we can chat! We announced the AI Product Day , a 1-day conference that will take place in Paris on March 31. We are looking for sponsors and the ticketing is open.
Adding high-quality entity resolution capabilities to enterprise applications, services, data fabrics or data pipelines can be daunting and expensive. Organizations often invest millions of dollars and years of effort to achieve subpar results. This guide will walk you through the requirements and challenges of implementing entity resolution.
See a longer version of this article here: Scaling ChatGPT: Five Real-World Engineering Challenges. Sometimes the best explanations of how a technology solution works come from the software engineers who built it. To explain how ChatGPT (and other large language models) operate, I turned to the ChatGPT engineering team. "How Tokenization. We
So he built a “clone” of a ridesharing app like Uber or Bolt: the app simulates riders requesting trips and drivers picking them up, then repeats this all over again. See it in action, here : A screenshot of the interactive “Rides” app. Here’s how Juraj approached the undertaking: Phase 0: make a plan (Oct).
By now most of us have experienced how Gen AI and the LLMs (large language models) that fuel it are primed to transform the way we create, research, collaborate, engage, and much more. Yet along with the AI hype and excitement comes very appropriate sanity-checks asking whether AI is ready for prime-time. Can AIs responses be trusted?
The internet has been speculating the past few days on which crypto company spent $65M on Datadog in 2022. I confirmed it was Coinbase, and here are the details of what happened. Originally published on 11 May 2023. 👋 Hi, this is Gergely with a bonus, free issue of the Pragmatic Engineer Newsletter. Can you possibly shed a little more light?“
As the value of modern in-app analytics becomes clearer, more companies are making analytics a priority before it becomes a problem. The longer you wait to modernize your application’s analytics, the harder you’ll eventually feel the pain of lost customers and missed revenue. If it sounds like a daunting task, that's because it is.
In this issue, we cover one out of six topics from today’s subscriber-only The Scoop issue. To get full articles twice a week, subscribe here. I got a message from a software engineer working at a company which laid off 30% of staff in December 2022. Also, there is business sense in doing this for reputational reasons.
I remember those days, oh so long ago, it seems like another lifetime. I haven’t used Pandas in many a year, decades, or whatever. We’ve all been there, done that. Pandas I mean. I would dare say it’s a rite of passage for most data folk.
Someone on Linkedin recently brought up the point that companies could save gobs of money by swapping out AWS Python lambdas for Rust ones. While it raised the ire of many a Python Data Engineer, I thought it sounded like a great idea. At least it’s an excuse to […] The post AWS Lambdas – Python vs Rust.
When I think back on the software engineers I looked up to, they all shared this trait where they never took anything at face value. They regularly questioned statements that did not make sense to them, no matter how small the topic was: even if it involved admitting they did not understand a concept. This person explained it. Or does it?
The business intelligence market has exploded. And as the number of vendors grows, it gets harder to make sense of it all. Don't go into the fray unarmed. This exhaustive guide with a foreword from BI analyst Jen Underwood dives deep into the BI buying process and explores how to decide what features you need.
In this article, we cover thee out of nine topics from today’s subscriber-only issue: The Past and Future of Modern Backend Practices. To get full issues twice a week, subscribe here. How have practices considered cutting edge on the backend changed from its early days, and where is it headed in future? and hand-rolled C -code.
Today, the market cap of the company has collapsed by nearly 90%, to $3.37B at time of publication. This is less than it attracted in fundraising. The company is bleeding money: in 2022 it brought in $4.1B in revenue, while making a $1.6B net loss, with $1.8B cash (or its equivalent) on hand. in cash-like reserves.
Rethinking Object Storage: A First Look at CloudflareR2 and Its BuiltIn ApacheIceberg Catalog Sometimes, we follow tradition because, well, it worksuntil something new comes along and makes us question the status quo. For many of us, AmazonS3 is that welltrodden path: the backbone of our data platforms and pipelines, used countless times each day.
Without the backing of management, a large-scale rewrite is likely to fail. With this, it’s over to Lou. Use tech debt payments to get into the flow and stay in it A good reason to add new comments to old code before you change it is to speed up a code review. Adding comments is also a good way to reduce cognitive load.
Many application teams leave embedded analytics to languish until something—an unhappy customer, plummeting revenue, a spike in customer churn—demands change. But by then, it may be too late. In this White Paper, Logi Analytics has identified 5 tell-tale signs your project is moving from “nice to have” to “needed yesterday.".
A first, smaller wave of these stories included Magic.dev raising $100M in funding from Nat Friedman (CEO of GitHub from 2018-2021,) and Daniel Gross (cofounder of search engine Cue which Apple acquired in 2013,) to build a “superhuman software engineer.” Clearly, this would generate a handsome return for investors and founders.
We don’t frequently have CEOs on The Pragmatic Engineer: in fact, today is the first issue when we’re talking with a CEO – partially – about their CEO job. I’ve always wondered what it would be like to go from a developer, to eventually become the CEO of a large and growing company.
Three featured speakers listed at DevTernity 2021, 2022 and 2023, and JDKon 2024. These people do not exist. A year ago, I spent months doing an investigative report on how UK events tech company Pollen had its staff work for free, as it had run out of money but still kept operating. And I intended to keep this promise.
The name comes from the concept of “spare cores:” machines currently unused, which can be reclaimed at any time, that cloud providers tend to offer at a steep discount to keep server utilization high. Spare Cores attempts to make it easier to compare prices across cloud providers. Source: Spare Cores. Tech stack. Benchmarking tools.
Every time an application team gets caught up in the “build vs buy” debate, it stalls projects and delays time to revenue. There is a third option. Partnering with an analytics development platform gives you the freedom to customize a solution without the risks and long-term costs of building your own.
To get full issues twice a week, subscribe here. Google Domains is the third most popular domain registrar globally, in terms of the number of domains currently registered. With 10 million registrations, it sits as the fourth largest aggregate “domains holder”: behind GoDaddy (80M,) NameCheap (16M,) Tucows (11M.)
Bun was mostly built by Jared Sumner , a former Stripe engineer, and recipient of the Thiel Fellowship (a grant of $100,000 for young people to drop out of school and build things, founded by venture capitalist, Peter Thiel). Bun has other contributors, but Jared writes the lion’s share of code. Many developers are giving Bun a go.
AI adoption is slower than expected—but leaders are biding their time (Tomasz) 6. Small data is the future of AI (Tomasz) 7. The lines are blurring for analysts and data engineers (Barr) 8. Synthetic data matters—but it comes at a cost (Tomasz) 9. The unstructured data stack will emerge (Barr) 10. Not many companies are closing business from it.
As we approach the new year, it's time to gaze into the crystal ball and ponder the future. In this post, we delve into predictions for 2025, focusing on the transformative role of AI agents, workforce dynamics, and data platforms. The Rise of AI Agents "Agents all the way," as Rajesh aptly puts it, will likely be the anthem for 2025.
What should product managers keep in mind when adding an analytics project to their roadmap? Download this eBook to discover insights from 16 top product experts, and learn what it takes to build a successful application with analytics at its core.
A few months ago I wrote a blog post about event skew and how dangerous it is for a stateful streaming job. Since it was a high-level explanation, I didn't cover Apache Spark Structured Streaming deeply at that moment.
To get full issues twice a week, subscribe here. Google Domains was a breath of fresh air when launched in 2015. It stood out from domain registrar competitors with a simple and clean interface, transparent pricing – $12/year for popular domains – and its handy integration with Google Workspace and Google Sites.
Using Strobelight, weve seen significant efficiency wins, including one that has resulted in an estimated 15,000 servers worth of annual capacity savings. Strobelight, Metas profiling orchestrator, is not really one technology. Its several (many open source) combined to make something that unlocks truly amazing efficiency wins.
” I’ve been making my way through this book from software’s earliest days and taking notes of what’s remained the same in the 50 years since Mythical Man Month came out, which predictions the book got right or wrong, and what’s different about engineering today. Brooks calls this person “the surgeon.”
Outdated or absent analytics won’t cut it in today's data-driven applications. And they won’t cut it for your end users, your development team, or your business. That's what drove the five companies in this eBook to change their approach to analytics.
We organize all of the trending information in your field so you don't have to. Join 37,000+ users and stay up to date on the latest articles your peers are reading.
You know about us, now we want to get to know you!
Let's personalize your content
Let's get even more personalized
We recognize your account from another site in our network, please click 'Send Email' below to continue with verifying your account and setting a password.
Let's personalize your content