skysight-inc/HackerNews huggingface dataset:
Show HN: Multilingual Embedding Model for Images, Audio and PDFs
I love building RAG applications and exploring new technologies in this space, especially for retrieval and reranking. Here’s an open source project I worked on previously that explored a RAG application on Postgres and YouTube videos: https://news.ycombinator.com/item?id=38705535

Most RAG applications consist of two pieces: the vector database and the embedding model to generate the vector. A scalable vector database seems pretty much like a solved problem with providers like Cloudflare, Supabase, Pinecone, and many many more.

Embedding models, on the other hand, seem pretty limited compared to their LLM counterparts. OpenAI has one of the best LLMs in the world right now, with multimodal support for images and documents, but their embedding models only support a handful of languages and only text input while being pretty far behind open source models based on the MTEB ranking: https://huggingface.co/spaces/mteb/leaderboard

The closest model I found that supports multi-modality was OpenAI’s clip-vit-large-patch14, which supports only text and images. It hasn't been updated for years with language limitations and has ok retrieval for small applications.

Most RAG applications I have worked on had extensive requirements for image and PDF embeddings in multiple languages.

Enterprise RAG is a common use case with millions of documents in different formats, verticals like law and medicine, languages, and more.

So, we at JigsawStack launched an embedding model that can generate vectors of 1024 for images, PDFs, audios and text in the same shared vector space with support for over 80+ languages.

- Supports 80+ languages
- Support multimodality: text, image, pdf, audio
- Average MRR 10: 70.5
- Built in chunking of large documents into multiple embeddings

Today, we launched the embedding model in a closed Alpha and did up a simple documentation for you to get started. Drop me an email at yoeven@jigsawstack.com or DM me on X with your use case and I would be happy to give you free and unlimited access in exchange for feedback!

Some limitations:

- While our model does support video, it's pretty expensive to run video embedding, even for a 10 second clip. We’re finding ways to reduce the cost before launching this, but you can embed the audio of a video.
- Text embedding is the fastest response, while other modalities might take a few seconds. Which we expected as most other modalities require preprocessing
I don't think I'm doing anything crazy, the odd game from steam, some ML models from huggingface, running a Plex server for myself and friends/family. I checked my usage and regularly exceed 1TB every month, so that's why I was put off.

I've been lucky that a new ISP came to my area and I can avoid Openreach infrastructure completely, they've put a FTTH line directly into my house and offer up to 8Gbps symmetrical
How McDonald sells millions of burgers per day with event-driven architecture
Very large "single product" services, the focus being on "very large". It would also be relevant in the cases where your product is made up of a large number of micro-services, though if you have more than 50 services to support your main product I'd be interested in knowing why you have that many services. There might be completely sane reasons, but it is a special case.

Mostly a question of scale to me, I'd guess that the majority (80-90%) of people running Kubernetes don't have large enough scale that it makes sense to take on the extra complexity. Most Kubernetes installations I've seen runs on VMs, three for control plane and 2 - 5 for worker node and I don't think the extra layer is a good trade off for a "better" deployment tool.

If you do use Kubernetes as a deployment tool, then I can certainly understand that. It is a reasonably well-known, and somewhat standardised interface and there's not a lot of good alternatives for VMs and bare metal. Personally I'd just much rather see better deployment tools being developed, rather than just picking Kubernetes because Helm charts are a thing.

You'd also need to have a rather dynamic workload, in the sense that some of your services is need a lot of capacity at one point in time, while other need the capacity at another time. If you have constant load, then why?

It's like Oracle's Exadata servers, it's a product that has its place, but the list of potential buyers isn't that long.
https://better-auth.com :)
K8s requires a flat plane addressability model across all containers, meaning anyone can see and call anyone else?

I can see security teams getting uppity about that.

Also budgetary and org boundaries, cloud providers, disaster recovery/hot spares/redundancy/AB hotswap, avoid single tank point of failure.
If this is the future i don't think you're missing much
It does not list any special privilege except drawing over other apps. I think the author could justify the network permission or they could remove it, but I personally don't consider it a big problem as-is anyway.

https://developer.android.com/training/permissions/requestin...

The Play Store lists these permissions:

* view network connections
* full network access
* run at startup
* draw over other apps
* prevent device from sleeping

The only one that gives me pause is "draw over" because it would allow the app to capture screen content, and that is only concerning because of "full network access" enabling it to send data. I'm not sure why this app would require _both_ of these permissions.

https://reports.exodus-privacy.eu.org/en/reports/com.actureu...
How can I even know which capacitor is faulty?
I couldn’t get into Janet, I’m not sure if this is a personal failing on my part. The only other Lisp I’ve spent any significant time in is Emacs Lisp, and everything in Janet seemed similar enough to that but just subtly different that I was always making silly mistakes. The PEG features were really compelling on paper but I found the syntax unwieldy and confusing. The documentation was complete in that it had descriptions of all the functions, but spartan in that it lacked examples or other helpful usage information. There didn’t seem to be any basic batteries included such as JSON parsing; if I want to write a quick script in a language and I have to first write a JSON or XML parser, task is already failed.

This was like four years ago, so maybe the ecosystem is better now. Or maybe scripting was the wrong ruler to measure Janet by. I don’t know but this post is making me want to reinstall it.
The UI in the home page screenshot also looks like 90s-era Windows.
I too had the battery bloat issue back in 2020 with my XPS. I won't be buying one ever again.
Yep, in the UK we knew it from the Budweiser adverts. Before that there was the frogs Bud, Weis, Er. Apparently they were originally a Superbowl ad, but again they were just shown on normal TV here.
The complexity of k8s comes the moment you need to hold state of some kind. Now instead of one systemd entry, we have to worry about persistent volume claims and other such nonsense. When you are doing things that are completely stateless, it's simpler than systemd.
I mostly ignored them. When the schools tried to send home worksheets I counseled my kids, "Do a few problems until you're sure you know what they're trying to teach. Then stop." I resented the school infringing on our family time.

The grades were not exactly annoying so much as useless. The teacher was supposed to know the kid and know where their strengths and weaknesses were, address them. Producing a letter grade from a pile of paper was only what, 2 bits? of information about my kid.

Student-teacher conferences could be good. If they remembered my kid at all, and knew anything about how they were doing in their class. If they opened their grade book during the conference, I would close it and get their attention back, say "Tell me about my child's behavior in your class."

Honestly, letter grades are no better than a scarlet letter to hang around the kid's neck.
> Would a USB3 external drive help with this?

Emphatically yes. It's an entirely different experience using a RPi 4 with a quality SSD. [0] It's also more expensive, so you have to decide whether that's important to you.

[0] https://www.samsung.com/us/computing/memory-storage/portable...

In my opinion it's a mistake to split the difference with a cheap SSD or one you need to plug in using a SATA to USB adapter. (troubleshooting first step: if it's not the power supply, it's the SATA to USB adapter...)
The Python type system is pretty bad, but it's still 100x better than not using types. We are heavy users of the (Rust) type system at Svix, and it's been a godsend. I wrote about it here https://www.svix.com/blog/strong-typing-hill-to-die-on/

We also use Python in some places, including the shitty Python type-system (and some cool hackery to make SQLAlchemy feel very typed and work nicely with Pydantic).
I wouldn't trust the management of this team for anything. They appear totally incompetent in both management and basic half-brain analytical skills. Who in the heck creates a cluster per service per cloud provider, duplicate all the supporting services around it, burn money and sanity in a pit, and blame the tool.

Literally every single decision they listed was to use any of the given tools in the absolute worst, incompetent way possible. I wouldn't trust them with a Lego toy set with this record.

The people who quit didn't quit merely out of burnout. They quit the stupidity of the managers running this s##tshow.
I see — have you tried Jabra? Their in-ear headphones have a great pass-through mode (as well as ANC/others) that work really well for me when I'm running.
> "the turtles are metaphors"

:( The turtles were real, not metaphorical: http://classicacorn.computinghistory.org.uk/8bit_focus/logo/...

(it fits the definition of metaphor 'One thing conceived as representing another; a symbol' but it has the feel of people saying "my niece thought the floppy disk save icon is a refrigerator because that's where you save leftover food" not realising that it was a real piece of fun/cute hardware many moons ago).
"Function coloring problem"

Function coloring isnt a problem, it is just approach
Sales, logistics, technical support, administration and accountancy for the entire EU market. Software engineering and some R&D.
Whatever. OpenAI charged me 15 times to refill my account and don’t respond to my chat about it for over two weeks. AX cut them off thinking it was fraud.

And when they did contact me, they completely ignored my comment that my keys had not been leaked, as the usage showed less than $20 of use.

A problem occurred and, as is becoming more normalized, the customer is always at fault.
I typehint the stuff that is easy. My observations about typehinting in Python track the 80:20 rule or even a 90:10 rule. You get about 80% benefit for typhinting the easy 20%.
> Who pays for telecommunication cables on the ocean floor?

TIL, it's a mix of private venture and public money [1], depending on which cables we're talking about. The ownership of those cables is also interesting [2] (granted, the source is a bit dated, but I can imagine that's still a trend):

> The leaders of today’s boom are two of the biggest generators of data traffic: Google and Facebook. Internet companies are behind about four-fifths of transatlantic cable investment planned for 2018-20, up from less than 20 percent in the three years through 2017, according to TeleGeography. Google has become “by far the biggest investor” in submarine cables, even taking full ownership of two of them—a reflection of the vast amounts of data the company transmits, says Mike Conradi, a lawyer at DLA Piper in London who’s been working on undersea fiber deals since 1999. Content companies “can make or break these cables.”

[1] https://en.wikipedia.org/wiki/Submarine_communications_cable...

[2] https://archive.is/PcXvn

Edit: Formatting.
How much of Dlink's target market would both understand and care?
The style and tone of this book (website) is quite funny, I really enjoy it.
Not OP, but I've been meaning to pick up a used business phone and connecting it to a VoIP number for a home phone
Y Combinator startups are overhyped and the founders need to just look like the VC's grandkid to get money.
As an experiment, I wanted to try something similar, but more extreme maybe since it's not Android AFAIK

https://www.thelightphone.com.

Also I wonder if my app is working nicely on an e-ink smartphone, very interesting.
They seem to have reappeared out of stealth mode. I wasn't aware of their rebrand.
I think it's more that Africa is more populated than people realise and the Beatles weren't as "worldwide" as people realise
The Raspberry Pi is one of the only random gadget purchases that I've made over the years that found their way to the back of the drawer, then found their way out, back to the drawer, and out again. It's a really useful general purpose tool.

It's currently running at my parents' place as a VPN server to let them access their smart home and cameras from outside the house (I didn't let them expose these to the internet).
Ooh that's great, I might give it a try.
The problem (in my opinion) is that Python gives you the tools (and perhaps even encourages you) to write code that would benefit from typing.

It's perfectly feasible to write maintainable, well-designed code in a dynamic language. I've worked with some extremely robust and ergonomic Clojure codebases before, for example. However, in Clojure, the language pushes you into its own "pit of success".

Personally, I never feel that with Python.
I still remember when I first learned about Huffman Coding so many years ago. Computers/math are amazing.
Valve Deckard 'Roy' Controller Models Discovered in SteamVR
I only have one real option even nearby a high population density area, Comcast.
C# is the best designed lang out of the top10 most popular langs
IKEA don't do software, but if they did
I've been predicting this. When Greece had their economic collapse in the 2010s, foreign companies lined up to hire everyone with more than 3 brian cells. Right now it's China, but I assume other countries with tech sectors (Israel, UAE, and India come to mind) and the like are quietly hiring people away from US/European companies, too.
Last time I checked it (a few years ago), it was quite buggy and crashed often for me (self-hosted).

For example, what I remember, there was a module to move photos from Google Photos, but it always stopped at 10% photos without any errors. Then there was also some document suite module and it would hang my entire machine regularly, for some reason (had to restart it).
>Often you'd need production, staging, test, development, something like that.

Normally in K8s, segregating environments is done via namespaces, not clusters (unless there are some very specific resource constraints).
> Can you explain your definition of "doxxing"

Revealing people names and addresses and implying that they have done something illegal, while the person doing that (this Krebs guy) does not represent the Law/the relevant authorities. See the Boston bombings debacle on this very website.

> why you believe that means nothing he writes is serious?

See the Boston bombings debacle on this very website.
The vulnerabilities impact modem products rather than router products. If you have one of these modems, you'll need to replace the modem functionality with another modem. You can, however, place an OpenWrt router/firewall on your LAN side just past the modem.
If the D-link has a wall wart which you could easily replace, try that. (And maybe a real surge strip, if you've got one handy.) Iffy power can cause all sorts of bizarre behavior.
You can make it up to 128 characters. That's impressive that you are able to type a random string of nonsense so fast.

My hack was to take a picture on my phone, have Apple's image recognition copy the string to my iCloud clipboard, and I'd paste it on my mac.

It's too easy to defeat the purpose of these things if you're even slightly driven.
Exploring Codehound: An Automated Smart Contract Auditing Tool by CyberSanctus
That type of pedantry is why people make fun of the free software movement. And if programmers don’t take it seriously, good luck convincing anyone else. Pick your battles.

“Product” doesn’t mean closed-source or paid, it’s simply the result of an action or process. The product of your cooking at home is a meal that feeds you. The product of your coding effort is a binary, a script, a set of files, or something else that satisfies a need. It doesn’t have to be a business need. A product that doesn’t sell or isn’t made to be sold is still a product.
Listening to music isn't a networked activity.
Apple's Chief People Officer Carol Surface Resigns
It's neat to compare Janet to GNU Guile. Guile's original pitch is that it's intended to be easily used side-by-side with C. However, because it's an older language, it hasn't (to my knowledge) picked up newer sensibilities like having a package manager shipped with the language toolchain.

One thing I like about Guile is how much effort they've put into describing compatibility with the RNRS standards. Not sure how Schemey Janet actually is, but I'm curious to find out.
221B is 221B Baker Street, where Sherlock Holmes lived.
It's just a matter of time before someone releases an orchestration layer for k8s clusters so the absurd Rube Goldberg machine that is modern devops stacks can grow even more complex.
Probably Qualcomm, who makes Atheros chips
This is cool as a project, but relying on humans to do pixel-perfect matching for security is probably a bad idea (well, glyph-perfect).
Isn't one of the strategies also to run one or two backup clusters for any production cluster? Which can take over the workloads if the primary cluster fails for some reason?

In a cloud environment the backup cluster can be scaled up quickly if it has to take over, so while it's idling it only requires a few smaller nodes.
An Offline Nuclear Reactor Led to Thousands of Cancelled Hospital Appointments
Building a Copilot #2: Parsing and Converting on the Fly
A quick mention of your staple vegetarian protein sources ? :)
How the far right is weaponising AI-generated content in Europe
YAML is not declarative, it's a format. Well, according to Wikipedia it's a "data serialization language". IMO It's also bad choice for this, and those files become unreadable and hard to work with.

Agree that shell scripts are also hard to work with, especially if you did not write them yourselves. I guess it's a combo of the language features of, say bash, and that no one who writes them really know bash. I mean, at all. Including me.

Declarative is nice, but also have pros and cons. And, it's of course many ways to achieve this if that's a priority.

Usually, what you really want is: Low time to replicate AND no data loss if a server blows up. But this also have to extend to, say, the k8 cluster. And, again, many ways to achieve this.

The article does not call for Ansible setups and shell scripts though.

Cloud Run uses YAML btw. One of the things I personally don't like about it
Hope the Romaninas unite to defet Georgescu in the final election round.
I work with an engineer fresh out of college. He asks chatGPT literally anything and everything. He has two monitors and one is just chatGPT all the time. I thought i use it quite a bit more than most but for him it’s almost stream of conscious dump to verify his code, various thoughts about the system, anything and everything really.

Maybe not for everyone but at least for him, and quite possibly others, Google isn’t even a thing.
Inside Elon Musk's Quest to Beat OpenAI at Its Own Game
Does it do this on iOS? I just cancelled RT because it crashed on my work computer all the time but if the phone app weren’t useless that might be different.
Brother monochrome laser is the only kind of home printer worth owning, honestly.
Sometimes, when people see my code, they remark how diligently and comprehensively I document my code. They are quite impressed.

But the truth is, my undocumented projects baffle me if I leave it for a month. Usually not because the code is complicated, but because the dataflows are or some external API behaves a certain way or there is some quirk in how a use case is implemented.

So as a matter of practice, I make it a habit to document everything so that if I'm coming back to it, I can quickly pick it back up.

McConnell's Code Complete has a great quote that I always have in mind:

> “The information contained in a program is denser than the information contained in most books. Whereas you might read and understand a page of a book in a minute or two, most programmers can’t read and understand a naked program listing at anything close to that rate. A program should give more organizational clues than a book, not fewer.”
I think it's really the AI content that people care about. Devices to disguise a voice have been around for a long time, so I don't think it was a particularly widespread job in the first place.

(And maybe technological changes in that space have always been about style and perception instead of effectiveness? I mean you can always get a paid actor to pretend to be the disguised interviewee and use a radio to relay the answers the show wants.)
Oh, I speak freely as they would have a very hard time finding me these days, and I already pissed them off almightily on my way out the door with a bag of misbegotten loot, and that was a few years ago, and my brains have yet to be ventilated.
It's Not Your Imagination. Airlines Are Padding Flight Times
Why are there gaming chairs, and why do they look like race car seats?

I drive a sports car that can corner at ~1G and the seats have bolsters on the side to keep your body in place when cornering hard- but they also make the seat uncomfortable on a long drive, it is a substantial tradeoff. It would seem impossible for a seat on wheels to have any lateral forces at all?
This is very cool:

> this book contains a repl, and you can summon it whenever you’d like by pressing the escape key on your keyboard. The book will then start downloading like a megabyte of JavaScript and WebAssembly, and once it’s done you will be able to try out Janet right here in the comfort of your browser. No need to install anything; no need to leave the comfort of this book website if you’d like to test something out.

> The repl is not just a repl, though. It is also a portal into conversation with me, the author. You can use the repl to report typos or factual errors, ask questions, or express confusion. I won’t be able to respond in the repl, but if you include some kind of contact information in your reports I will make an effort to follow up with you.
So, I'll ask more explicitly: what's your definition of "having a runtime"?
Would have loved to know more about this, but I sure as heck am not going to pay to find out.
> WRT54-GL, WNDR3700(v2,v4) and WNDR3800, Netgear R7800.

The WRT54-GL stands out, while having a really long support life it's also just FE, 10/100Mbps. The others are gigabit Ethernet. Could possibly be replaced from the list by the D-Link DIR-825 (N, not AC) which is also at the same support level as the Netgear WNDR3700v2.
Ask HN: Most useful 3D printed items?
Hey

So, I just got a 3D printer (Bambu lab A1).

I have a bunch of small things in mind to build with this. But I was wondering if there are items that you printed that you wish you had known about earlier.
"Warhammer 40K" generates perfectly good lawsuit material: a space orc on a bike (knight) and a space marine with a bolter (pawn) in a classic WH40k pose. Also some Eldar-like pieces I didn't recognise.
Also full agreement! In an optimistic view, the SQL layer (at a slightly higher level) unifies the top level accessibility tools (NLP, drag/drop chart result builders, etc) with the more tech-familiar level of analysts/engineers, and provides progressive disclosure as you go down the stack and a path to promote the adhoc/SQL level work up to reporting easily.
A creative bishop inspired by Alien ... somehow it does not get it right.
Formulating a problem well is half the solution already.
Light Mode