r/LocalLLaMA • u/Scutoidzz • 18h ago

I Built A Thing LSearch - Spotlight for windows with embedding

Enable HLS to view with audio, or disable this notification

I built a spotlight search for windows. It has an embedding model and a MoE models to go with it.

The MoE

It's 2 Qwen 3.5 4B models, I fine tuned one for coding work and another for agentic work, and then I combined them both into an MoE. I didn't want to shove it into everything so you can use it to fix code and that's about it

Embedding Model

it uses embeddinggemma 2 (270M) It currently doesn't have image support.

---

I used Opus 5.5 to write it

The model is here: https://huggingface.co/scutoid/2x4B but if you have 16GB of ram or more, the app will ask you if you want to download it and it'll download it without you needing the link

The app source is here. The exe is under releases: https://github.com/blueprintnerd/LSearch

42 Upvotes

85% Upvoted

13 comments sorted by

7

u/TheAndyGeorge 18h ago

it'd be interesting to add this support directly to Flow Launcher

5

u/DataGOGO 18h ago

safetensor format please.

2

u/Scutoidzz 18h ago

yeah give me some time I'll upload it

1

u/Scutoidzz 14h ago

I uploaded them check the HF

1

u/DataGOGO 14h ago

Awesome!

2

u/mountainyoo 18h ago

Ah hell yeah definitely downloading this

1

u/Quiet-Trick6700 17h ago

Great work ! How big is the data? And how long did it take to embed it?

2

u/Scutoidzz 17h ago

70K items across my computer and it took 28 seconds on my thinkpad

1

u/-Cubie- 16h ago

Why doesn't it have image/audio/video support? Can't you just use SentenceTransformer with Flash Attention 2? It ships with multimodal support, and I think it might be faster than llama.cpp too for a model this size.

1

u/cruncherv 6h ago

Voidtools Everything is similar and works instantly. Although no embedding

-5

u/Far-Situation-3869 18h ago

curious how the agentic model would handle roleplay scenarios, like keeping character details straight over long chats.