All the ones I mentioned can be installed with pip or uv if I am not mistaken. It would probably be more finicky than containers that you can put behind a reverse proxy, but it is possible if you wish to go that route. Ollama will also run system-wide, so any project will be able to use its API without you having to create a separate environment and download the same model twice in order to use it.

Ollama for API, which you can integrate into Open WebUI. You can also integrate image generation with ComfyUI I believe.

It’s less of a hassle to use Docker for Open WebUI, but ollama works as a regular CLI tool.

You’re right! Sorry for the typo. The older nomic-embed-text model is often used in examples, but granite-embedding is a more recent one and smaller for English-only text (30M parameters). If your use case is multi-language, they also offer a bigger one (278M parameters) that can handle English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, Chinese (Simplified). I would test them out a bit to see what works best for you.

Furthermore, if you’re not dependent on MariaDB for something else in your system, there are also some other vector databases I would recommend. Qdrant also works quite well, and you can integrate it pretty easily in something like LangChain. It really depends on how much you want to push your RAG workflow, but let me know if you have any other questions.

Have a look at Ollama embeddings. Easy to set up and the models are much smaller than a typical LLM.

For notes, I have moved to Joplin with the option to synchronize my data using a WebDAV server. It works really well, and it has both a mobile and desktop app. If you’re interested in developing your project, maybe you can have a look at the options this provides. For example, I really like the ability to separate notes between groups, assign tags, create drawings, and the possibility to use Markdown.

Good luck with your projects! To mirror @enemenemu’s suggestion, I would also look into collaborating with the people trying to push the EU Docs alternative. Not sure if that will work, but it’s worth a shot if you’re interested :D

Ok, but there are laws involved here. In Romania, you can’t be president if you are under 35 years old, or, among others, if you have a criminal record. The people that were stopped from running for president weren’t barred because they went against the mainstream parties, but because they openly promoted personalities that were doing the equivalent of the Holocaust in Romania. This is punishable by law by up to 3 years in jail, and they’re being actively investigated.

The lady in this post was previously denied her run in the summer of last year, and she kept quiet about it until now because they probably told her they won’t pursue it further if she steps back. She took the deal, probably because she realises that she’d rather keep grifting on Facebook than spend 3 years in jail.

How can you have democracy if you let people vote for a person that says he will remove all political parties? There must be checks and balances that stop you at some point. Also, Romanian law prohibits candidates with ties to fascist or extremist ideologies from participating in elections. That’s in the law, introduced by people that were democratically elected.

But lets be honest, it’s the not being hostile to Russia that did it. Can’t have that in a US colony where they plan to have the biggest base for their imperialist wars.

Sure, the US that is now serving up its allies on a silver platter to Putin? His friend Trump is going to revert sanctions any day now for that sweet oil. For power in the Middle East, maybe, but the EU is hopefully going to wake up soon and kick all American bases ASAP.

And who helped the openly fascists ukranian to power in 2014?

Firstly, the Euromaidan protests didn’t get hundreds of thousands of people attending just because they got brainwashed by the EU/US. Allegedly, Russia attempted to do the same thing in Romania with Georgescu, and only a few hundred people showed up to protest the decision to take him off the ballot. People in Ukraine felt betrayed when Yanukovych wanted to reject EU and get closer with Russia, a country that has had 146% voter turnout during one of its recent elections. Arguably, maybe the EU is not the best, but its system is way more decentralized than Russia’s, allowing better representation of its population and reducing the chance of corruption. At least we don’t hear people that are criticizing the government “randomly” falling out of windows here…

Secondly, Poroshenko was openly fascist? Or whom exactly do you mean? If I’m not mistaken, Poroshenko assigned a Jewish person as his prime minister. Or you might be hinting at the Azov Brigade being integrated by him into the national army? What would you do when Russia starts invading your country, though? Either way, you might be right that it is in the benefit of the EU (and perhaps US) to have closer ties with Ukraine, but it goes both ways. Ukraine did not like what happened in Georgia, and wanted more security and pro-democracy allies. That does not mean that the EU made Ukraine into a Nazi puppet state to fight Russia.

No, democracy is when you are intolerant with the intolerant. Maybe read up on what she says/does before commenting.

Fooyin is also a solid choice.

On PC: Linux, LibreOffice, LibreWolf, BetterBird, Lemmy, Invidious, Le Chat + Ollama (w/ Open WebUI), Proton stack, moved to Helix for development rather than VS Code.

On phone: EMUI (yes, I’m changing my phone soon 😂), F-Droid + Aurora, IronFox, SimpleX + Signal, Loops, Pixelix, Organic Maps and HERE WeGo (for local transport), pipepipe, DeepL.

Planning on getting the upcoming Fairphone 6, if the rumours are right, and it comes out in the summer. I’m also considering the Shiftphone 8.1, but I haven’t heard much about it before this year. I previously wanted to get a Pixel and put GrapheneOS on it, but I’d rather not have my money go to Google. Although, I currently rely on Google Wallet to pay without a card, but I might just go back to carrying my wallet with me rather than send more data to Google about my purchases.

Someone shared this link earlier: https://madein.md/en

I also had to upload 2000 photos. The issue was that they had to encrypt each, which took me like 2 days with it running in the background 😅 It could have also been due to my phone being quite old. I don’t rely on it that much, other than using it as an off-site back-up for my most important documents.

I do agree that the best choice is a self-hosted solution with proper security, but sadly not everyone has the time or the skills to manage that. The Proton CEO thing also annoyed me, but the Proton Foundation as a whole has good opinions about privacy (e.g., against chat control proposal in the EU). However, next time a slip like this happens from them, I’ll probably have had enough time to move my stuff to a local deployment.

Proton offers a Drive, and they’re based in Switzerland. I don’t see them being strong-armed like this by the UK government any time soon.

Piracy. I’d buy albums if I had money, though. I’ll slowly phase into getting them once I get some more cash.

I can find most stuff I listen to, and I rarely grow my music library. I mostly listen to 20-30 albums, with some more mainstream music peppered in.

My music library currently sits at 90 gigabytes (mostly flacs), so quite small compared to others I’ve seen around here. Still, I have plenty of variation to keep me entertained :D

If you have Tidal, aren’t there some apps to rip the lossless audio from there? You could get most of the stuff that you need, and then cancel the subscription. If you feel bad, maybe order some merch from the band, haha.

The Linux kernel is not flawed, and Redox is probably years away from being even near it. However, having memory-safety from the get-go as a requirement for developing the kernel could lead to fewer exploits, compared to what we have today with Linux. Just as you’ve said, most users are not aware of it/they don’t care, but the big players will care about keeping information safe on their servers. Just to conclude, Redox OS is not just Linux rewritten in Rust, and could potentially have many other benefits that are particularly juicy for data centers. Too bad it’s not production ready yet :D

That’s unfortunate :( I think you can still run it in QEMU, if you’re interested.

I see your point. However, integrating Rust properly in the Linux kernel is an uphill battle. Redox OS is not at all close to being stable, but it showcases that you can build a Rust kernel from scratch, and integrate it into an OS that meets some of the requirements of a modern one. Of course, considering it a toy project and glancing over its potential doesn’t help with adoption. They even mention in their description that currently they can only support a community manager and a student developer with the current donations. When you compare that to the amount of money and developers involved in the Linux kernel, it’s insignificant.

I was not suggesting that the Rust For Linux devs jump ship, but it could be beneficial for the investors behind the project to look at alternatives. Heck, the Linux kernel started as a toy project itself. I believe that a team focused solely on such a Rust-only kernel could spearhead needed changes to reach something stable, as opposed to investing time and money into fighting established C developers to integrate a memory-safe language in the kernel fully.

Organic Maps. Make sure you download the areas beforehand. The resolution for walking paths is much nicer, and you can clearly see the routes of temples and other points of interest.

It also shows data about drinking faucets, toilets, and other things provided by users.

Good luck! You can try the huggingface-chat repo, or ollama with this web-ui. Both should be decent, as they have instructions to set up a docker container.

I believe the Llama 3 models are out there in a torrent somewhere, but I didn’t dig to find it. For the 70B model, you’ll probably need around 64GB of RAM available, but the 7B one should run fine with just 8GB. It will be somewhat slow though, compared to the ChatGPT experience. The self-attention mechanism can be parallelized, which is why you will see much better results on a GPU. According to some others that tested it, if you offload some stuff to RAM, you could see ~10-12 tokens per second on an RTX 3090 for certain 70B models. But more capable ones will be at less than 1 token per second, all depending on the context window you use.

If you don’t have a GPU available, just give the Phi-3 model a try :D If you quantize it to 4 bits, it can apparently get 12 tokens per second on an iPhone haha. It should play nice with pooling information from a search engine, or a vector database like milvus, qdrant or chroma.

What db2 already said. Microsoft just released Phi-3 mini, which could, allegedly, run locally on newer smartphones.

If I understood correctly, the Rabbit thingy just captures your information locally and then forwards it to their server. So, if you want more power, you could probably do the same by submitting the same info to a bigger open source model than Phi-3, like Llama 3, hosted on your homelab. I believe you can set it up with huggingface/gradio, which sort of provides an API that you could use.

That way, you don’t need a shitty orange box, and can always get the latest open source models with a few lines of code. There are plenty of open source frameworks in the works at the moment, and I believe that we’re not far off from having multi-modal LLMs running on homelab-level hardware (if you don’t mind a bit of lag).