DataEngineer.io Newsletter
Subscribe
Sign in
Home
Data Engineering Academy
Videos
Archive
Leaderboard
About
Latest
Top
Discussions
Top 3 LLM frameworks that you should know
There are a lot of libraries and frameworks coming out in the LLM space.
4 hrs ago
•
Zach Wilson
and
Filip Makraduli
19
Share this post
Top 3 LLM frameworks that you should know
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
How GenAI will impact data engineering
GenAI is catching fire over the last two years.
Oct 11
•
Zach Wilson
116
Share this post
How GenAI will impact data engineering
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
6
The Hard Truth About Bad Data Models
And how to fix them!
Oct 1
•
Zach Wilson
37
Share this post
The Hard Truth About Bad Data Models
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
September 2024
My learnings from 7 failed tech interviews
Job interviews are stressful.
Sep 19
•
Zach Wilson
122
Share this post
My learnings from 7 failed tech interviews
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
8
How to avoid pipeline backfill nightmares
Tired of the backfill process? Checkout these best practices to help you ease the pain of backfilling the data.
Sep 16
•
Zach Wilson
and
Junaid Effendi
45
Share this post
How to avoid pipeline backfill nightmares
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
6
August 2024
When to pick SparkSQL vs DataFrame vs Dataset
Spark offers so many different APIs and languages that it can be overwhelming which way is “best.”
Aug 23
•
Zach Wilson
58
Share this post
When to pick SparkSQL vs DataFrame vs Dataset
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
1
Engineering cultures: Meta vs Netflix vs Airbnb
I spent seven years working at the behemoths Facebook, Netflix, and Airbnb and I learned a ton about culture over that period of time.
Aug 14
•
Zach Wilson
130
Share this post
Engineering cultures: Meta vs Netflix vs Airbnb
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
6
Data products = the future of data engineering
Data products are the systems and machinery that print big tech billions of dollars every year!
Aug 3
•
Zach Wilson
85
Share this post
Data products = the future of data engineering
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
9
July 2024
How to pass data engineer interviews in 2024
Data engineering interviews can feel unpredictable and you don’t quite know what to expect!
Jul 1
•
Zach Wilson
104
Share this post
How to pass data engineer interviews in 2024
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
3
June 2024
How I built a huge graph database of Netflix's cloud infrastructure
Microservices are amazing and painful at the same time!
Jun 20
•
Zach Wilson
52
Share this post
How I built a huge graph database of Netflix's cloud infrastructure
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
3
How to choose between batch, micro-batch, and streaming when building a data pipeline
Speed is all the rage in data engineering nowadays.
Jun 4
•
Zach Wilson
66
Share this post
How to choose between batch, micro-batch, and streaming when building a data pipeline
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
4
May 2024
Why it's hard for data engineers to get promoted after senior engineer
And things you can do to overcome it!
May 21
•
Zach Wilson
54
Share this post
Why it's hard for data engineers to get promoted after senior engineer
blog.dataengineer.io
Copy link
Facebook
Email
Note
Other
22
Share
Copy link
Facebook
Email
Note
Other
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts