PZ's picture

PZ PRO

philipp-zettl

·

philipp-zettl

AI & ML interests

NLP/CV/Multimodal learning

Recent Activity

upvoted an article about 2 hours ago

FineWeb2-C: Help Build Better Language Models in Your Language

reacted to mitkox's post with 🚀 about 2 hours ago

llama.cpp is 26.8% faster than ollama. I have upgraded both, and using the same settings, I am running the same DeepSeek R1 Distill 1.5B on the same hardware. It's an Apples to Apples comparison. Total duration: llama.cpp 6.85 sec <- 26.8% faster ollama 8.69 sec Breakdown by phase: Model loading llama.cpp 241 ms <- 2x faster ollama 553 ms Prompt processing llama.cpp 416.04 tokens/s with an eval time 45.67 ms <- 10x faster ollama 42.17 tokens/s with an eval time of 498 ms Token generation llama.cpp 137.79 tokens/s with an eval time 6.62 sec <- 13% faster ollama 122.07 tokens/s with an eval time 7.64 sec llama.cpp is LLM inference in C/C++; ollama adds abstraction layers and marketing. Make sure you own your AI. AI in the cloud is not aligned with you; it's aligned with the company that owns it.

reacted to fdaudens's post with ❤️ about 2 hours ago

Yes, DeepSeek R1's release is impressive. But the real story is what happened in just 7 days after: - Original release: 8 models, 540K downloads. Just the beginning... - The community turned those open-weight models into +550 NEW models on Hugging Face. Total downloads? 2.5M—nearly 5X the originals. The reason? DeepSeek models are open-weight, letting anyone build on top of them. Interesting to note that the community focused on quantized versions for better efficiency & accessibility. They want models that use less memory, run faster, and are more energy-efficient. When you empower builders, innovation explodes. For everyone. 🚀 The most popular community model? @bartowski's DeepSeek-R1-Distill-Qwen-32B-GGUF version — 1M downloads alone.

View all activity

Organizations

philipp-zettl's activity

New activity in LSX-UniWue/Betzerl_1B_wiki_preview 2 months ago

Error when loading adapter

#1 opened 2 months ago by

New activity in philipp-zettl/disco-elysium-FLUX-lora 3 months ago

Add generated example

#1 opened 3 months ago by

New activity in philipp-zettl/ChessPT 4 months ago

Interesting games

#1 opened 4 months ago by

New activity in philipp-zettl/chessPT 4 months ago

Update README.md

#1 opened 4 months ago by

New activity in philipp-zettl/bart-large-cnn 4 months ago

Create handler.py

#1 opened 4 months ago by

New activity in philipp-zettl/qa-generator 8 months ago

Update app.py

#2 opened 8 months ago by

merge master into main

#1 opened 8 months ago by

New activity in dataautogpt3/ProteusV0.4 11 months ago

Can the gpt caption/prompt process be shared?

#2 opened 11 months ago by