r/learndatascience

RAG workshop with open models (Aug 29), no API costs to worry about
โ–ฒ 20 r/learndatascience+5 crossposts

RAG workshop with open models (Aug 29), no API costs to worry about

If you're trying to get into RAG and generative AI but keep bouncing off tutorials that assume you already have API budget or existing infrastructure, this might help.

There's a hands-on session on August 29 that builds a full production-style RAG system using entirely open models, no API fees involved anywhere in the process. Covers hybrid retrieval, evaluation, guardrails, and cost benchmarking, the parts that actually separate a working demo from something you understand end to end.

Good one if you want to learn by actually building rather than just watching a walkthrough.

Here is the workshop details

u/camerongreen95 โ€” 1 day ago
โ–ฒ 29 r/learndatascience+3 crossposts

How do Python for-loops work?

What actually happens when Python executes a for-loop?

for value in container:
    print(value)

Behind the scenes, Python uses the iterator protocol:

iterator = iter(container)
while True: 
    try: 
        value = next(iterator)
        print(value)
    except StopIteration:
        break
  • iter(container): creates an iterator.
  • next(iterator): retrieves one value at a time.

When there are no more values, the iterator raises StopIteration. The for-loop catches this exception automatically and ends the loop.

For containers that support backward iteration, Python also provides:

  • reversed(container): creates a backward iterator.

We can support these operations in our own classes by implementing:

__iter__()
__reversed__()
__next__()

This provides a powerful abstraction: an algorithm can process values without needing to know how a container stores them internally. The same algorithm can therefore work with lists, sets, dictionaries, linked lists, trees, and many other containers.

Here's an example that uses ๐ฆ๐ž๐ฆ๐จ๐ซ๐ฒ_๐ ๐ซ๐š๐ฉ๐ก to show the use of iterators on a Linked_List making the invisible mechanics of iteration visible for easy understanding.

more memory_graph examples

u/Sea-Ad7805 โ€” 1 day ago

How do you decide which machine learning model to use for a project?

When you have a dataset and want to build a model, how do you decide where to start?

Do you usually try a simple model first, look at the type of data, compare a few models, or use another approach?

I'd like to know how people make this decision in real projects.

reddit.com
u/duneofarrakis โ€” 1 day ago
โ–ฒ 9 r/learndatascience+3 crossposts

I focused on full-stack development until my 3rd year โ€” now I want to move seriously into ML/research. What should I learn next?

Hi everyone,

Iโ€™ve mainly been focused on full-stack development throughout the first few years of my degree. Now that Iโ€™m in my 3rd year, Iโ€™ve started thinking more seriously about my long-term direction, and Iโ€™m becoming much more interested in machine learning and research.

My goal isnโ€™t just to learn how to use ML libraries. Iโ€™d eventually like to understand the fundamentals well enough to read research papers, do my own research, and potentially pursue a research-focused masterโ€™s/PhD.

Right now, Iโ€™m planning to study these three DeepLearning.AI programs:

  1. Mathematics for Machine Learning and Data Science
  2. Machine Learning Specialization
  3. Deep Learning Specialization

The math specialization covers linear algebra, calculus, probability, and statistics, while the ML specialization focuses on foundational ML algorithms and practical implementation.

My question is:

Is this a good learning path if my long-term goal is ML research?

What would you recommend I add or change?

For example:

  • Should I study more mathematics beyond these courses?
  • Should I learn statistics more deeply?
  • Should I learn PyTorch, NumPy, etc. separately?
  • When should I start reading research papers?
  • Should I work on Kaggle/projects before trying research?
  • Are there any textbooks or university courses (Stanford/MIT/etc.) that you would strongly recommend?
  • Should I specialize in an area such as NLP, computer vision, or something else?

Iโ€™d really appreciate advice from people who have gone through a similar transition from software/full-stack development โ†’ machine learning โ†’ research.

Thanks!

u/OppositeGround9175 โ€” 3 days ago
โ–ฒ 1 r/learndatascience+1 crossposts

Is DSA really required for a ML Engineer

Hiii..!!! I'm currently in my B.Tech 3rd year and studying Artificial Intelligence and Machine Learning along with Data Structures and Algorithms (DSA). And I'm really confused that 'Is DSA really required for a ML Engineer' ? Like how can I integrate DSA in my machine learning projects.

And, I would be really thankful if you solve my confusion so that I can boost my preparation without any doubt.

Also, If I can use it in my projects, then how can I learn to do it? Like any yt channel or something.

reddit.com
u/Nakul549 โ€” 2 days ago

Can someone tell me how can I start my career in Data science??

Considering I'm a beginner who has no knowledge at all where and what can I start like skills projects and basics to understand more like a step by step guidance

reddit.com
u/Material-Truth6396 โ€” 2 days ago

Roadmap to become a data scientist

Hello
My name is Dario. I'm 19 years old, currently doing an associate's in Programming and will transfer for a bachelor's in Data Science. I was wondering on what is actually the best way to become a data scientist right now. I have some basic knowledge of Python and SQL. I was wondering if the path to becoming a data scientist has changed with the development of AI and where I should focus on to actually master important valuable skills that will help me land jobs. I do have a potential internship position lined up in the future at Miracle Software and have been trying to prepare for that interview. Just wanted to know what are some resources I should check out and what skills I need to learn. I appreciate all feedback and advice!!!

reddit.com
u/Musashi049 โ€” 3 days ago

What skill took you the longest to become comfortable with in Data Science?

I'm learning Data Science and I'm curious about other people's experiences.

For those who work in Data Science, what skill took you the longest to become comfortable with?

Was it statistics, Python, SQL, machine learning, data cleaning, or something else?

reddit.com
u/duneofarrakis โ€” 5 days ago

What is one thing you wish you had learned earlier when starting Data Science?

I'm learning Data Science and trying to understand what beginners should focus on first.

For people who have experience in the field, what is one skill, tool, or concept you wish you had learned earlier?

reddit.com
u/duneofarrakis โ€” 4 days ago

Tutors needed!

Hi everyone, so Iโ€™m going back to school but given my current class load and situation I need a tutor to help me. If anyone knows a good tutoring service please let me know. Please and thank you!!!

reddit.com
u/Badgaming992 โ€” 4 days ago
โ–ฒ 3 r/learndatascience+1 crossposts

How to keep non frequent knowledge in mind?

As a beginner I don't know how to keep things like oop in my mind until i reach the level that i need it in as for know (i am studying data cleaning and EDA) i didn't find a use for it yet

reddit.com
u/Acadec-Scallion-64 โ€” 4 days ago

Learning R & Python for Educational Data Analysis

Hi everyone, I need some advice on learning data analysis for educational research. My advisor suggested learning R and Python, but my background is limited to basic statistics and SPSS. I have zero experience with R, and I've only used Python once (via AI-generated code with NumPy).

โ€‹How should I structure my learning path to master both tools effectively starting from scratch? Any concrete steps or recommendations would be greatly appreciated. Thank you!

reddit.com
u/Zhi1231 โ€” 5 days ago
โ–ฒ 7 r/learndatascience+5 crossposts

Most A/B tests break before they even run

https://preview.redd.it/g3h65ltymsjh1.png?width=767&format=png&auto=webp&s=e01808b3b6d935d47ae5d9f5c8300345c72fabed

A business team wants to test something. They pull a customer list, split it in half, and run the test. That split is usually where it goes wrong.

Splitting randomly across the whole base can leave one group with more customers from a specific profession, region, or education level than the other. When the results come in, nobody can tell whether the difference came from the test or from the composition of the groups.

There is also the sample size question, which most teams skip entirely. If the base is too small to detect the effect you care about, the test will come back inconclusive no matter how well you run it. That is a calculation you do before, not something you discover after two weeks of waiting.

I built a pipeline that handles this part: upload a customer base, get back two stratified groups with proportional composition, the minimum sample size backed by power analysis, and a statistical check (t-test and chi-square) proving the split was fair. Output is two CSV files plus a plain text summary the business team can actually read.

Tested it on a bank marketing dataset with 11k customers. Stratified by profession, marital status and education, the resulting groups came back with p-values above 0.99 across every variable, meaning no meaningful skew in either direction.

Hub: https://aiforfintech.tech
Github: https://github.com/junidepieri-design/expd-001-ab-test-design-pipeline

How does your team handle the split when designing a test?
๐Ÿ‘Š

reddit.com
u/AIforFintech โ€” 5 days ago
โ–ฒ 311 r/learndatascience+45 crossposts

I've been building a SQL learning platform for the past few months. It's called QueryCase and I'd love honest feedback

I've spent the last few months building something and I'm finally at the point where I want to share it properly rather than just quietly hoping people find it.

The idea came from a frustration I kept seeing (and feeling myself): SQL tutorials teach the syntax fine but there's never a reason to care about the answer. You filter a table called employees, get a result, and nothing happens. Your brain doesn't bother keeping it.

I wanted to try a different approach. QueryCase teaches SQL through detective investigations. You get a briefing from Chief Fox (our mascot), a real database to query, and a mystery to crack. The JOIN matters when a suspect has an alibi. The WHERE clause matters when you're trying to find who entered the building at 22:13. The SQL is the tool for solving something, not the point in itself.

Here's what's actually in it:

  • A structured learning path across 54 cases, going from Recruit through Rookie, Detective, Senior Detective, and Chief Detective. Each rank has drills and a level exam to pass before you progress.
  • Sandbox mode where you can explore real datasets (IMDB movies, Spotify, sports stats, Steam games) and run whatever you want with no pressure and no mystery attached. Just free exploration against actual data.
  • Everything runs in the browser using DuckDB WASM so there's nothing to install.

I'm a solo developer and this is genuinely early days. I'm sharing here because this community is exactly the kind of people I built it for, and I'd rather get honest feedback now than find out later I've built the wrong thing.

What's missing? What would make you actually stick with something like this versus what you've used before?

querycase.com if you want to take a look.

Any feedback appreciated!

u/conor-robertson โ€” 10 days ago

Coding Machine Learning

Coding Machine Learning.

Hello Folks, here I present the first coding demonstration lecture, based on my 1st lecture on Probabilistic Machine Learning.

Here I write the code from scratch, discuss and analyze the results, which were covered in details in the whiteboard classes.

What we cover?
-Random Variables, and validating law of large numbers.
-Visualizing a dataset
-Doing an EDA on Iris dataset and understanding the correlation among features.
-Classifier basics
-Empirical Risk Minimization and Generalization.
-Epistemic and Aleatoric Uncertainties.
-Softmax Function and LogSumExp Trick to avoid overflow issues
-Linear Models
-Maximum Likelihood Estimation.
-Simple end to end ML pipeline Function.

While writing the code, my intent is to ensure that concepts are understood with crystal clarity. These code demonstrations are specific to my theory ML lectures, and link is attached.

Theory-Intuition-Code

Implementation Link : https://youtu.be/X_yOlx8Zp4g?si=kh8_tzzndr8609u4

Theory Lecture Link : https://youtu.be/kMkCOrp8te8?si=q7kWr-1qK515bhob

u/Negative_War_65 โ€” 6 days ago
โ–ฒ 841 r/learndatascience+6 crossposts

Teaching Python the right way

Programming courses often focus heavily on understanding code, while paying far less attention to understanding the program state. But code does not exist in isolation. Its main goal is to change the program state, before ultimately producing some output.

To develop an accurate mental model of program execution, students need to understand both:

  • the instructions being executed
  • the values, references, and data structures those instructions create and modify

Reading code alone does not always reveal how the program state changes during execution. That is why I created ๐—บ๐—ฒ๐—บ๐—ผ๐—ฟ๐˜†_๐—ด๐—ฟ๐—ฎ๐—ฝ๐—ต: a tool that visualizes the state of a Python program as it changes, step by step.

It can help explain a wide range of introductory Python topics. Here are just a few examples:

Instead of reconstructing the program state from print statements, students can now watch it change as each line executes. This makes unfamiliar concepts easier to understand and bugs easier to fix.

Help your students learn Python programming more thoroughly and easily.

See: more examples

u/EmadFahim134 โ€” 11 days ago
โ–ฒ 865 r/learndatascience+7 crossposts

I made a little cat doodle about data analysis ๐Ÿฑ

I tried explaining a data analysis concept in a fun, visual way โ€” for cat lovers. ๐Ÿ˜ธ
Would love to hear what you think! Any feedback or suggestions are very welcome :)

u/Ok-Adhesiveness-8757 โ€” 12 days ago
โ–ฒ 2 r/learndatascience+1 crossposts

Need help Iโ€™m a intern

Try do EDA on the company data but Iโ€™m not able to how to approach it how to find the pattern or any things Iโ€™m not able understand

My mentor tell me to perform EDA on it

reddit.com
u/No-Watch6723 โ€” 8 days ago
โ–ฒ 27 r/learndatascience+3 crossposts

Machine Learning Topics for 2026

Basically I try to learn ML to get a role in the AI Related not exactly a ML engineer. So for that learning from the basics like Math concepts and back propagation etc., every topic that used to train our model from scratch is a better method of learning or

2: RAG, LLM related topics , MCP, Agentic AI learn how they actually work instead of going deep into the actual structure(basically exclude the math and how model trained).

Which way of learning is good for future?

Why do I ask this means every job application I go through I only see the latest topic not the core of ML. In my opinion, Learning the upper layer of AI is pretty simple when compared to going deep into math like back propagation,math concepts,and gradient descent etc,. Is spending time on learning everything is worth the time?

reddit.com
u/Mysterious-4620 โ€” 10 days ago