Building a fanfic archive alternative with better "similar fic" recommendations. What are your biggest software gripes with Ao3?
[deleted]
[deleted]
هل نعيش أكبر عملية طمس للمعلومات في التاريخ الحديث؟
دراسة نُشرت في مايو 2024 تقول:
38% من صفحات الويب التي كانت موجودة عام 2013 لم تعد متاحة بعد عشر سنوات.
من جميع الصفحات التي جُمعت بين عامي 2013 و2023، اختفى أو أصبح غير متاح نحو 25%.
حتى صفحات عام 2023، كان نحو 8% منها قد اختفى.
54% من صفحات ويكيبيديا تحتوي في قسم المراجع على رابط واحد على الأقل يقود إلى صفحة لم تعد موجودة.
وفي عينة من منصة X (تويتر سابقًا)، أصبح نحو 18% من المنشورات غير متاح للعامة خلال بضعة أشهر فقط.
ومع الاعتماد المتزايد على الذكاء الاصطناعي، يرجّح البعض أن تتجاوز نسبة صفحات الإنترنت التي تختفي 50% خلال السنوات القادمة.
أمازون** تشتري كتبًا**** نادرة** ثم تقطعها وتمسحها وتتخلص منها لتغذية أنظمة الذك**اء الاصطناع****ي**.
بائع** كتب وضع جهاز AirTag داخل كتاب نادر ضمن طلب جماعي مجهول شمل نحو 1000 عنوان عبر Biblio.
انتهى التتبع في مستودع أمازون LAS8 في لاس فيغاس، وتحديدًا****** في قسم VGT3،**** الذي يحمل شعار ديناصور يح**مل كتاب****ً**ا.
وبحسب** ما نُقل****** عن بعض العاملي********ن**:
نستلم الشحنات، ونقطع الأغلفة لتسريع عملية المسح، ثم نتخلص من الكتب.**
أمازون** أكدت شراء الكتب عبر قنوات تجارية بهدف تطوير منتجاتها، دون توضيح سبب التخلص منها أو حجم هذه العملية.**
هذا** يطرح احتمال أننا دخلنا بالفعل مرحلة ندرة البيانات الخام عالية القيمة، بعدما استُهلك**** جزء كبير** من المحتوى المتاح على الإنترنت في تدريب نما**ذج الذكا****ء** الاصطناعي.
فالكتب القديمة توفر نصوصًا بشرية أصلية ونظيفة، خالية من المحتوى المولد بالذكاء الاصطناعي. لكن المشكلة أن الحصول على هذه البيانات قد يأتي على حساب إخراج نسخ من الكتب، بعضها قد يكون نادرًا، من التداول العام.
اضف على ذلك اعكبر موقع للكتب الرقمية Z-Library تم اغلاقه بحجه حقوق النشر
Are there any uncensored models? One of the issues I ran into with llama is that any discussion that sits adjacent to sexual or even political matters is basically blocked. Creative content ideas that walk the line between uncouth and commonly shared experiences/truth cannot even be discussed with the agent. I haven't explored taboo topics like talking about political figures or racism, but the models avoid touchy subjects in general. Has anyone found a solution?
To harden your content pipeline against hallucinations while keeping the LLM’s role minimal, you need to fundamentally shift your architecture: Move from an "Agentic" paradigm to a "Deterministic Orchestration" paradigm.
In an agentic workflow, the LLM decides what to do next, writes code, or chooses tools. This is where hallucinations break pipelines (e.g., the LLM hallucinates a file path, invents an API parameter, or gets stuck in a loop).
To minimize the LLM's role, treat it as a dumb, highly constrained function rather than an autonomous agent. The surrounding code (Python, Node, etc.) should handle all logic, state, and execution.
Here is the blueprint for hardening your video and social media pipeline.
The fastest way a pipeline breaks is when an LLM hallucinates a Python script to run FFmpeg or call a social API.
If you ask an LLM to "write a script and give me the hashtags," it might format it differently every time, breaking your parser.
Instructor (Python) or Zod (TypeScript). Force the LLM to output strictly typed JSON.class VideoScript(BaseModel):
hook: str = Field(max_length=150)
body: str = Field(max_length=800)
cta: str = Field(max_length=100)
visual_prompts: list[str] = Field(min_items=3, max_items=5)
Outlines or Guidance to guarantee the output matches a JSON schema at the token level. It makes malformed JSON mathematically impossible.Never pass LLM output directly to the next step in the pipeline. Put a "bouncer" (validation code) between every LLM call.
Video generation APIs (Runway, Pika, Sora, HeyGen) frequently fail, timeout, or return artifacts. The LLM cannot fix this; your code must.
Whisper (on the generated TTS audio) or StableFast3D to generate exact word-level timestamps for captions, rather than relying on the LLM to guess when words are spoken.Social APIs (TikTok, Instagram, YouTube Shorts) are notoriously strict and change frequently.
Because this is going to public socials, a 100% autonomous pipeline is a business risk. Minimize the LLM's role by making the human the final agent.
Here is what your hardened workflow should look like in practice:
By treating the LLM strictly as a text-and-data extraction engine, and using deterministic code for all orchestration, validation, and execution, you effectively eliminate hallucination-induced pipeline breakages.
Hey Guys, I stumbled on this webpage while trying to search Opencode Go plan, Commandcode is very cheap then Opencode. Is anyone here tried this plan? Whta is your experience on this? Please, thank you!
DeepSeek quietly (then very loudly) pushed the official **DeepSeek-V4-Flash-0731** over the past day or two, and the community is going crazy for good reason.
### Quick specs
- **284B total / 13B active** MoE
- Native **1M context** (same as V4-Pro)
- MIT license, open weights now on Hugging Face (`deepseek-ai/DeepSeek-V4-Flash-0731`, ~167GB FP4/FP8 mixed)
- Pricing unchanged and still absurdly cheap: **$0.14 / $0.28** per 1M input/output tokens (cache hits ~$0.0028, a 98% discount)
- Supports thinking modes (High / Max), Responses API format, and is fully adapted for Codex
- Available on DeepSeek’s own API (public beta), OpenCode (including free tier), Cline (they made it free), etc.
### The big story: Agent capabilities got *massively* upgraded
DeepSeek re-did the post-training. Same architecture/size as the April preview, but the agent scores jumped hard and now beat the old **V4-Pro-Preview** across a bunch of agent benchmarks.
Highlights floating around:
- Terminal-Bench 2.1: **82.7** (was ~56.9 on the preview — +25+ points)
- Strong gains on other agent/tool-use suites (DSBench, Toolathlon, etc.)
- Artificial Analysis Intelligence Index: **50** (up ~10 points from the original Flash). That puts it in the top 3 open-weights models on their board, competitive with recent Gemini Flash / GPT-5.6 Luna-tier models on intelligence while being dramatically cheaper.
People are calling it one of the best performance-per-dollar models in its class right now.
### LMArena / Arena.ai results (the part everyone’s screenshotting)
Arena.ai (formerly LMArena) has been posting updates:
**Frontend Code Arena** (the one lighting up timelines):
- DeepSeek-V4-Flash-High: **#7 overall**, **#3 open**, score **1586**
- Categories: #4 Consumer Product, #6 Reference-based Design / Data & Analytics / Gaming, #7 Brand & Marketing
- +154 pts vs the Flash High Preview, and even +121 pts vs the old V4-Pro Preview
It literally reshaped the Pareto frontier on that board for performance-per-dollar.
Earlier (April) Text/Code Arena numbers for the original preview were more modest (Flash thinking was around #10 open / #47 overall on Text Arena). The new post-training version is clearly a different beast on agentic/coding tasks.
### Community vibes from popular tweets
- People running tens of millions of tokens for a couple of dollars (or less) thanks to the cache hits
- “This is the first flash model that actually feels SOTA”
- OpenCode, Cline, and others racing to integrate it (some making it free)
- Lots of “Chinese open models aren’t just catching up anymore” energy
- Some skepticism about vendor-harness numbers (fair), but independent Arena + Artificial Analysis numbers are looking strong
- Local runners already trying the new weights
### Where to try it
- chat.deepseek.com (Expert/Instant Mode)
- Official API (model name `deepseek-v4-flash`)
- Hugging Face weights
- OpenCode / Cline / various third-party providers
This feels like DeepSeek doing the classic move: ship a very strong, very cheap open model that punches way above its active-parameter weight, especially for agents and coding. The gap between “Flash” and “Pro” on agent tasks has basically collapsed after this update.
Anyone already deep into long agent runs or heavy coding workloads with it? Drop your experiences / cost numbers / failure modes below.
What began as a food safety scandal over contaminated “toxic” cooking oil is becoming what some call the biggest existential crisis yet for Taiwan’s DPP.
The Specter was on the ground in Taipei, talking to protesters who made clear the discontent goes far beyond the current yo crisis.
“The DPP deliberately creates division, glorifies Japanese colonization, vilifies mainland China, and denies their own ancestry,” one protester told The Specter.
About 60% of respondents in Taiwan support the protests, organized by the KMT opposition, according to the latest polls.