r/dataanalysis

Image 1 — A single country distorted my European mood trend, so I tried reweighting the data
Image 2 — A single country distorted my European mood trend, so I tried reweighting the data
▲ 2 r/dataanalysis+1 crossposts

A single country distorted my European mood trend, so I tried reweighting the data

I’m running a small side project where people anonymously report their current mood from 1–10.

I was looking at Europe using a rolling average of 100 responses, and noticed a very sharp jump at the end of April.

At first, it looked like European mood had suddenly increased by about 1 point.

But when I looked at the composition of those rolling windows, I found the problem: at one point, Spain accounted for up to 83% of the 100 European responses.

So what looked like a European trend was largely a change in the geographic composition of my sample.

Before correction:
The late-April rolling mean jumps by about +1.09 points.

I then tried a simple reweighting approach: Spain is still included, but it can contribute at most 20% of the weight in each rolling window of 100 European responses.

After correction:
The jump is reduced to about +0.89 points.

So Spain explains part of the apparent jump - but interestingly, not all of it.

This made me realize that fixing the rolling sample size doesn't necessarily fix the sample composition.

The data are anonymous and self-selected, so I'm not treating this as a representative estimate of European mood. I'm mostly interested in how best to visualize and analyze this kind of uneven crowdsourced dataset.

How would you handle this?
Cap each country's contribution? Weight countries equally? Use population weights? Or avoid producing a single “Europe” curve altogether?

u/gloussou — 23 hours ago

What is the hardest part of working with real-world data?

I'm learning data analysis and so far I've mostly worked with clean datasets. I'm curious about what real-world data is actually like.

What do you find most difficult when working with real data missing values, messy data, choosing the right metrics, understanding business requirements, or something else?

I'd be interested to hear what experienced analysts struggle with the most.

reddit.com
u/duneofarrakis — 1 day ago

How should I start learning Python?

I want to learn Python, but I currently know nothing about it. My main goal is to learn Python for DA, and eventually I want to learn Python in depth as well.

For people already working in DA or DS, how would you recommend someone start learning Python from absolute zero?

Which resources or books would you recommend, and what are the main Python topics I must cover for DA?

Also, should I first learn the Python basics needed for DA and then gradually move toward more advanced Python and DS topics? resources? Books?

If you work in DA or DS, I’d really appreciate your guidance on how you would start your Python journey if you were starting from zero.

Thanks a ton!!!

reddit.com
u/Maximum-Page3433 — 1 day ago

What is the biggest mistake beginners make when learning data analysis?

I'm learning more about data analysis and I'm curious about what experienced analysts think.

What do you think beginners spend too much time on or focus on the wrong way?

For example, is it trying to learn too many tools, focusing too much on theory, not practicing with real data, or something else?

I'd like to hear what mistakes you made when you were starting out and what you would do differently now.

reddit.com
u/duneofarrakis — 2 days ago

Built my first Excel-only dashboard (no Power BI/Tableau) and placed 1st runner-up in a skill sprint

Wanted to share since I learned a lot doing this.

For a competition called the DSSD Skill Sprint, I built a dashboard analyzing NVIDIA's global sales — using synthetic/AI-generated data since real data obviously isn't public. The twist: I did it entirely in Excel, no Power BI, no Tableau, just pivot tables, slicers, and native charts.

Honestly didn't expect to place — ended up 1st runner-up out of the group, which was a nice surprise for my first real dashboard project.

Biggest challenges I ran into:

Handling nulls/blanks scattered across the dataset

Inconsistent date formatting that broke my pivot tables initially

Negative stock values that were throwing off my totals until I filtered/cleaned them

Nothing groundbreaking technically, but it proved to myself that Excel alone can tell a solid data story if you're deliberate about cleaning first.

Happy to share screenshots or specifics on the formulas/pivot setup if anyone's curious

u/_divine__wolf — 3 days ago

Looking for an online study group for data analytics

I’m currently learning Data Analytics, but I struggle to concentrate and stay consistent when I study alone at home. I feel like having a study group or study buddy would help me stay accountable and motivated.

I’m looking for an online study group where people are learning Data Analytics and can study together regularly, discuss doubts, practice SQL/Python/Excel, work on projects, and keep each other accountable.

I’m a beginner, so I’d especially like to connect with other beginners or people who are also currently learning.

If you know of any active online study groups, Discord servers, communities, or are interested in forming a small study group, please let me know. I’d really appreciate any suggestions!

reddit.com
u/Slow_Commercial_6719 — 3 days ago

Assumed VIP customers would drive most of our revenue — the data said otherwise

Working through a series of applied analytics projects on real transactional-style datasets, and this finding didn't match my assumption going in.

The setup: 700 customers, 1,826 orders, ₹4.93 Cr total revenue. Customers are segmented into VIP and Regular tiers.

I expected VIP to clearly outperform on revenue — that's usually the point of having a tier system. Instead:

- VIP customers: 48.8% of revenue
- Regular customers: 48.6% of revenue

Essentially a dead heat. The VIP tier isn't actually the revenue driver the segmentation implies.

A few other patterns that came out of the analysis:
- Jaipur and Chennai post the highest cancellation rates (18.5% and 18.3%) despite only mid-tier revenue — worth digging into whether it's a logistics/fulfillment issue in those cities specifically
- Home & Kitchen and Electronics lead category revenue
- Revenue spiked sharply in the final month of the dataset — still working out if that's seasonality or a one-off event

Built the analysis and dashboard end-to-end (data prep, DAX measures, visuals) — happy to share more on the methodology if useful.

Dashboard here if you want to explore the underlying data yourself: https://app.powerbi.com/links/MV5f1O4X6V?ctid=f1e56b10-5f67-4e70-bd40-8c6948bde6cf&pbi\_source=linkShare

Has anyone else run into this kind of tier-parity result? Curious whether it's common enough that VIP segmentation criteria usually needs revisiting, or if this dataset is just an outlier.

u/Kauser_Analytics — 3 days ago

How do you actually test whether a BI tool is worth switching to or just looks good in demos?

Been poking at a few BI tools lately because Power BI isn't always the right fit for every freelance project and clients sometimes have opinions. The thing is, every tool looks reasonable in a demo or a YouTube walkthrough built on clean sample data. The gap between that and real messy client data with weird relationships and inconsistent naming is where tools either hold up or fall apart.

My rough approach right now is to take one actual dataset from a past project, something with a few joins, some nullheavy columns, and at least one calculated field that requires conditional logic, and just try to build the same thing in the new tool. If it takes three times as long and the documentation assumes you already know the tool, that's usually a signal.

What I'm less sure about is whether that's a fair test or if I'm just making it harder than it needs to be because I'm already comfortable in one environment. There's probably some bias there.

Curious what others use as a baseline when evaluating a new tool. Do you have a goto test dataset or a specific workflow you run through, or is it more of a feel thing after a few hours of use? Also wondering if there's a point where time spent evaluating stops being useful and you're just procrastinating on the actual work.

reddit.com
u/Exact_Entertainer600 — 2 days ago

What do you wish you knew when you started learning Data Analysis?

When I started learning data analysis, I thought I needed to learn every tool before I could actually work on projects.

Over time, I realized that focusing on the basics was much more useful:

  • SQL
  • Excel
  • Data visualization
  • Basic statistics
  • Understanding the problem behind the data

I'm curious to hear from people who have been doing data analysis for a while.

What is one thing you wish you knew when you first started learning data analysis?

reddit.com
u/duneofarrakis — 4 days ago

How can i use databricks in my data analysis work/project??

Recently I just thought of learning databricks and i am from data analysis background...so i wanna know like how can i integerate these two ogs tech into one project to get a mess. I really wanna do it and i want suggestions of u guys not an AI this time.

reddit.com
u/Mean_Agent_3529 — 3 days ago
▲ 11 r/dataanalysis+1 crossposts

Shopify Sales data analysis

I have conducted a cohort analysis for repeat customers and analyzed their Customer Lifetime Value (CLV).

u/Party_Initiative_621 — 4 days ago

Help a writer word thier query to get the right data?

I am writing an article about plant related heat stress. I am looking for stats to reference in support of the extreme RANGE of tempurature fluxtuation that can occure in southern Canada within a 24hr period during the summer.

I've been struggling to find accurate phrasing, and thus the data I'm looking for, since I'm not looking for daily tempurature averages or "average daily lows vs. average daily highs" but instead looking for a data set that includes record of the largest range that occurred within a 24hr period for each calendar month.

Is RANGE the correct term?

Also, when I use the term EXTREME in my queries the search engine assumes I'm looking for articles on extreme weather events/ global warming.

reddit.com
u/carlyfries33 — 3 days ago

What's your most underrated tool as a data analyst?

the thing you reach for that most people overlook or dismiss. Could be a feature/a workflow/an old school tool.

reddit.com
u/nomadicaeropress — 6 days ago

Too much data - no idea where to start

I've become somewhat the data person at my work. I've got a spreadsheet listing information for around 800 tutors that have worked with us over the years, and I have around 30 columns of data for each tutor - start date, hours worked, location, training, opportunities sent vs opportunities responded to, etc. I just feel completely lost! I'm used to coming with analysis for far smaller data sets

Could anyone recommend a short-ish online training or programme that could help me learn how to sort it all out and especially how to present it? I don't want to spend weeks going over all of this to have the end result be pointless.

Thanks!

reddit.com
u/harvico73 — 5 days ago

Are there people who run A/B experiments and do statistics/data projects without knowing what p-value is?

I mean just doing each step, but not having fundamental understanding about the essence of p-value and other statistical notions?

reddit.com
u/Ashamed-Designer4920 — 5 days ago

I will turn raw data into decisions for free

I have been learning data analysis - SQL, Tableu, Python doing mostly example projects. Feeling ready to deep dive into the real world. So: got messy sales data, a report you've been meaning to dig into, or a question your numbers could answer but haven't? Send it my way. I'll analyze it free you get clarity, I get experience and a testimonial. A win-win situation

reddit.com
u/mlukni22 — 4 days ago

Joining as only data person for company's new role

Hi, Im a new grad and recently joined a company as their only dedicated "data" guy, this is also a new role for the company. They do have some others that deal with data, but thats a thing they also do not exclusively like I will. Anyone done something similar? What was it like? Any tips?

reddit.com
u/AdObjective5502 — 6 days ago

I tried a flipbook-style Doodle on Data Analysis concept

I’ve been making these little Data Analysis 101 doodles for cat people, and for this one I tried something different — a flipbook-style format.

Instead of putting everything into one busy infographic, I’ve broken the story into separate scenes, so each one focuses on a single idea and hopefully doesn’t demand too much attention at once.

I’ve also incorporated feedback I received on my previous posts, especially around making the visuals easier to follow.

This one is about what to do when you join a data project that’s already in motion.

Would be happy to hear your feedback on this!

u/Ok-Adhesiveness-8757 — 5 days ago

Data analyst looking for a Mac-like Windows laptop — is there a good alternative?

I’m currently looking for a new laptop and could use some advice.
As a data analyst, I need Power BI and Microsoft Excel regularly, so Windows is unfortunately a better fit for my workflow. I really like the Mac ecosystem, though — the build quality, performance, battery life, smoothness, display, trackpad, and overall user experience are all things I genuinely prefer about MacBooks.
The problem is that I don’t want to compromise my workflow just because I like the Mac experience.
So I’m wondering:
Is there a Windows laptop that comes close to the MacBook experience in terms of build quality, performance, battery life, display and overall smoothness?
Would something like a Dell XPS, Lenovo Yoga/ThinkPad, HP Spectre, ASUS Zenbook, etc. be a good alternative?
Or, given that I like the Mac ecosystem so much, is it still worth considering a Mac and finding workarounds for Power BI/Excel?
For someone doing data analytics, how much of a disadvantage is a Mac really?
My priority is a laptop that feels premium and smooth like a MacBook, but still handles Power BI, Excel, SQL, Python, etc. without compromises.
Budget is flexible for now — I’m mainly trying to figure out whether I should go back to Mac or look for a Windows machine that gives me a similar experience.
Would love to hear from people who have actually made this switch either way.

reddit.com
u/NationalAdvantage367 — 6 days ago
▲ 13 r/dataanalysis+1 crossposts

[E] Confidence Intervals — Explained

Hi there,

I've created a video here where I explain what confidence intervals are and how they differ from probabilities.

I hope some of you find it useful and as always, feedback is very welcome! :)

u/Personal-Trainer-541 — 6 days ago