I trained a DQN agent to control a traffic light — it beats fixed-time signals by learning when to switch phases
▲ 1 r/OpenSourceeAI+2 crossposts

I trained a DQN agent to control a traffic light — it beats fixed-time signals by learning when to switch phases

I trained a DQN agent to control a traffic light — it beats fixed-time signals by learning when to switch phases

Built a reinforcement learning system where a Deep Q-Network controls a 4-way intersection in SUMO traffic simulator. Instead of cycling phases on a timer like real-world traffic lights, the agent watches live queue lengths and waiting times, then decides every step whether to hold the current phase or switch.

Trained for 1M timesteps against 80,000 vehicles. Compared it head-to-head with a fixed-time baseline on the same demand. DQN wins on average wait time, halted vehicle count, and throughput.

Stack: Python · Stable-Baselines3 · Gymnasium · SUMO/TraCI · Matplotlib

📓 Full notebook (with training loop, custom env, and all plots): https://github.com/jarif87/reinforcement-learning-algorithms

Happy to answer questions about the reward design or environment setup — those were the trickiest parts to get right.

u/Financial-Back313 — 1 month ago
▲ 4 r/chrome_extensions+1 crossposts

I built a lightweight Focus Timer + Task Manager Chrome Extension (FocusFlow by NikaOrvion)

Hey everyone 👋

I just published my Chrome extension called FocusFlow by NikaOrvion, and I wanted to share it with you all.

It’s a simple but powerful productivity tool designed to help you stay focused without distractions.

🚀 What it does:

FocusFlow combines a customizable timer + smart task tracking in one clean interface.

✨ Key features:

⏱️ Focus / Short Break / Long Break timer (1–180 min customizable)

🔄 Timer keeps running even when popup is closed

✅ Task manager (add, complete, delete tasks easily)

💾 Auto-saves tasks + session progress

📊 Session tracking synced via Chrome storage

🎨 Clean glass-morphism UI (light cyan theme)

⚡ Lightweight and distraction-free

🎯 Who it’s for:

Students trying to stay consistent with study sessions

Developers & professionals using deep work / Pomodoro

Creators who need focus without clutter

Anyone trying to improve time management

💡 Why I built it:

Most productivity tools felt either too heavy or too distracting, so I built something minimal, fast, and actually usable during real work sessions.

ChromeWebStore: https://chromewebstore.google.com/detail/ghmnhplkehigmhdggcmcepffnlkpklfn?utm_source=item-share-cb

u/Financial-Back313 — 2 months ago
▲ 6 r/BestFreeExtension+3 crossposts

Hey everyone,

Most dark mode extensions I’ve used either:

  • break layouts
  • mess up images/videos
  • or make text unreadable

So I built my own: DarkLens

What it does differently

Instead of simple color inversion, it:

  • rewrites colors intelligently (background → dark, text → readable light)
  • keeps images and videos unchanged
  • tries to preserve the original layout as much as possible

Features

  • 🎛️ Adjustable filters (brightness, contrast, sepia, grayscale)
  • 🌐 Per-site toggle (enable/disable instantly)
  • 📋 Allowlist / blocklist modes
  • ⏰ Auto schedule (including overnight)
  • ✨ Smooth transitions
  • ⚡ Works on dynamic sites (SPAs, etc.)

ChromeStore: https://chromewebstore.google.com/detail/kicfiliioepakfjhifhefajnlfahnpne?utm_source=item-share-cb

Honest note

Right now it runs on all websites by default.
I’m planning to improve automatic exclusions (like code editors / streaming sites), but that part isn’t perfect yet.

I’d really like critical feedback:

  • Which sites break for you?
  • Does it handle Reddit/YouTube properly?
  • What features would make you switch from your current dark mode extension?

If you want to test it, I can share the link.

Built this because other extensions annoyed me — curious if this one annoys you less 😅

u/Financial-Back313 — 4 days ago

Hey everyone 👋

I built a small tool called DevFontX (made by NikaOrvion) to improve the coding experience in web-based editors like Google Colab, Kaggle, Jupyter, GitHub, and other online IDEs.

If you’ve ever felt the default fonts are boring or hard to read, this might help.

✨ What it does

🔤 Switch between 14+ professional coding fonts (JetBrains Mono, Fira Code, Cascadia Code, IBM Plex Mono, and more)

🔍 Adjust font size instantly (12px → 80px)

👁️ Live preview before applying

⚙️ Works across Monaco, CodeMirror, Ace editors

🔄 One-click reset anytime

🛡️ Safe & simple

It only changes the code editor font, not the website layout or UI. So everything stays stable and distraction-free.

💾 Smart persistence

Your font + size settings are saved automatically, so no need to reconfigure every time.

💡 Why I made this

As someone who spends a lot of time coding in browser-based tools, I wanted a cleaner, more customizable font experience without installing heavy setups.

Would love your feedback or suggestions 🙌

ChromeWebStore: https://chromewebstore.google.com/detail/daikobilcdnnkpkhepkmnddibjllfhpp?utm_source=item-share-cb

u/Financial-Back313 — 3 months ago