u/Real-Huckleberry-934

I'll introduce myself, I am guy who's about to complete his degree. I know C, C++, Python, Rust, And ML, and stuff. So Recently i have been thinking about improving my communication to the next level. Tbh, I am not bad, People can understand my english really well, but having said that i feel i need to improve to the level of a native english speaking guy. So that is my motive, no string attached. I am GMT +5:30, Anyone native english speaking person or near native english speaking person can DM me if you need help with any topic. It's completely free of cost, but if you are willing to pay me, then I would accept it happily :) . Other things we can discuss in DM. PS: I have a digital pen and also I absolutely love to teach.

Hi, So I will list out the things i did first, Degraded MIUI to 12.5 android 11, Then flashed Orangefox recovery, In orangefox recovery I tried flashing Cdroid 10.0 Android 14, and NikGapps that package, After multiple booting to system it landed in recovery itself, Then i discovered the firmware needed to cdroid was miui 13, so i downloaded that firmware installed from recovery, I only clicked reboot from recovery, My phone is stuck in an eternal Boot loop, No Logo nothing, just black screen wakes up, turns off, repeats. I have tried MTKclient, but that is also not working. Any help would be really appreciated.

I have recently dived into rust, I am getting a hang of it slowly. Unlike other languages theory alone is actually difficult to manifest rust mentally, So I feel I should improve my understanding my coding more, and i feel it would be better if there are 1 or 2 max people so we can code some projects (non frontend) preferably ML based, We could conduct meets eventually, to discuss about the specifics of rust. No Vibe Coders preferred. Also doing projects means not being so academic textbook projects, and at the same time not so deep. It could be a balanced one in between. For me its about how we implement the projects more than what we do. Time : GMT +5:30. DM me or reply to this, we'll connect !.

Hi, I am new to rust and have written my first toy project in rust and published a crate, I am planning to add new features, If you guys have any ideas let me know!. Also if you can review my code for any suggestion, that would be very helpful!. I don't know how to do a CLI animation that shows making a Dosa, that would be cool!.

https://github.com/Mohammed-Saajid/Dosa

https://crates.io/crates/dosa

https://preview.redd.it/4kpmeus90e7h1.png?width=989&format=png&auto=webp&s=24c8d789debac7fa310b63ed966b743e7dc44f70

Hey everyone,

I am planning out a new open-source infrastructure project and want to get some brutal feedback on the architecture and use-case validity from people running high volume LLM workloads in production.

The Problem: Python-based proxies/gateways introduce too much latency overhead for real-time streaming agent steps or fast UI completions. Additionally, centralized semantic caching still suffers from cross-region network latency (e.g., London to us-east-1), and enterprise API costs remain a massive bottleneck for repetitive/predictable user queries (like customer support or structured data extraction).

The Proposed Architecture: Instead of a heavy centralized gateway, the goal is to build a lightweight, zero-dependency semantic cache running directly at the CDN Edge using WebAssembly (WASM) compiled from Rust.

The flow looks like this:

1. Inbound Prompt: Hits the edge node closest to the user (e.g., Cloudflare Workers / Fastly Compute).
2. Edge Embedding: The Rust/WASM module intercepts the raw text prompt and instantly generates a vector using an edge-native lightweight model (e.g., bge-small-en-v1.5).
3. Similarity Index Check: It performs a fast cosine similarity check against an edge vector database (like Cloudflare Vectorize) to find the nearest semantic neighbor.
4. Cache Hit: If similarity >= threshold (e.g., 0.88), it pulls the full generated response text from an edge KV store and returns it in ~5ms. The main LLM provider is never billed or touched.
5. Cache Miss: It proxies the streaming request to OpenAI/Anthropic/vLLM, streams it back to the client, and asynchronously updates the edge vector index and KV store.

Why Rust/WASM? To achieve sub-millisecond execution overhead on the proxy itself, avoid garbage collection pauses, and maintain a tiny memory footprint suitable for edge runtime constraints where traditional databases or Python scripts cannot run.

My Questions for the Community:

1. For those running LLMs in production (especially customer support, internal RAG, or autonomous agents), what is your realistic semantic cache hit rate? Is the power law of repetitive queries high enough in your domains to justify this?
2. What are the biggest footguns with semantic caching at the edge? (e.g., Cache invalidation strategies, handling system prompt updates, or drift in embedding models).
3. Would you actually use a drop-in open-source template/CLI that lets you spin this up on your own edge account, or do you prefer centralized API gateways?

Hey there, I am a 3rd year undergrad, I am looking for partners to work on any research problem in the ML space, (a genuine one). I won't use AI to blindly create slop and will take accountability for every line of code I type. I also expect the same from the partner :) . DM me if you think it would work out.

Hey there! I am looking to pick up a few students for tutoring, and I would love to help you master some tech skills.

I have a strong background in several programming languages and core computer science concepts. Whether you are looking to get comfortable with the basics or dive into more complex topics, I can help you get there.

Here is what I can teach:

• Programming Languages: C, C++, Python, and Rust.
• Operating Systems: Getting under the hood of how OS architecture actually works.
• Machine Learning: We can cover this from foundational concepts all the way up to advanced modeling. Since ML is a huge field, we can discuss your specific goals to tailor a roadmap that fits your needs.

My rate is 15 USD per hour. Since I am based in India, we can coordinate our schedules to find a time that works best for our respective time zones.

If you are interested or want to chat about what you are hoping to learn, just send me a message and we can take it from there!

Assalamu alaikum, I am an India based Undergrad student who's about to complete my degree. I always loved to teach and yesterday suddenly this thought crossed my mind. I wanted to offer 2 hours per week, in the weekend, slowly and sturdily. This one is completely for free. I want to do it for the sake of Allah SWT.

Ideally i am looking for young learners who is unable to afford a structured course, but if anyone is very passionate about learning programming then they could also join. If there are people like that in this community, Or if anyone can map me with such students, Kindly DM me, I'll share a gform to filter students. For anyone who is applying, a laptop or PC with internet connection would be good, but if they are not able to afford that then a good android phone would be sufficient.

Jazakhalla Khair.

I am a dev student 20M, I've been into software for years, I plan to get into GPU Programming very soon, and tbh it feels a lil bit overwhelming, although i haven't given a lot of effort still. I need someone to explain about the GPU architecture basics, how kernels operate in that, how data move between cpu and gpu and all that stuff intuitively. Just the basics to start climbing, i am not expecting a full stanford course obv. If you have that patience and are willing to have an online meet, it means you are awesome : ). Kindly DM me and we'll have the convo. Thank you!.