skysight-inc/HackerNews huggingface dataset:
Show HN: Bodhi App – Local LLM Inference
Hi HN,

Bodhi App is an open-source local LLM inference solution that takes a different and simpler approach. Instead of re-inventing the wheel, it leverages existing, tried and tested ecosystem and solutions:

## Technical Architecture:

- llama.cpp as inference engine

- Rust/Axum backend for type-safe API layer

- Tauri for multiplatform builds

- HuggingFace integration

- YAML based configurations and update at runtime (no restarts required)

- OpenAI/Ollama API compatibility layer

## Key Technical Decisions:

1. No proprietary model format - directly use of GGUF files from HuggingFace

2. Opt-in Authentication, provides RBAC for team access

3. API design with proper authentication/authorization

4. Built-in Swagger UI with complete OpenAPI specs

5. Built-in User guide

# What Sets It Apart:

Designed with non-technical users in mind. So it comes a basic Web-based user interface, allowing users to get started quickly with their first AI-assistant conversation.

## Setup Wizard:

- App displays a setup wizard when run for first time

- Allows user to download popular models in a user friendly way

## Built-in Chat UI:

- Ships with a complete Chat UI

- Chat UI is simple enough for non-technical users to get started with their first AI-conversation

- Adapts to power users by providing complete control over request settings

- Supports realtime streaming response, markdown rendering, code rendering with syntax highlights

- Displays chat stats, request tokens, response tokens, token speed

- Allow copying of the AI-response etc.

## Built-in UI for Model + App Management + API access:

- Manage complete Model lifecycle from the UI

- Downloading models, deleting models

- Configuring models, request + inference server configurations using Model Alias yaml files

- Allows configuring for parallel processing of requests

- Configuring App Settings - chosing betwen CPU/GPU, server idle time etc.

- API tokens for authenticated/authorized access to APIs by 3rd party

## Tech for UI:

- Uses Nextjs, Tailwindcss, Shadcn to build powerful, responsive and user friendly UI

- Supports Dark/Light mode

- Exported using config `output: "export"` to export the entire frontend as static html + javascript

- Served by the backend as static asset

- Thus no packaged nodejs server, reducing app size, complexity and compute

# Links

Try it out: https://getbodhi.app/

Source: https://github.com/BodhiSearch/BodhiApp

Looking forward to technical feedback and discussions.
Examples of Keywords?
Have you been to LinkedIn recently. It is the "dead internet theory" in practice. Every single post, every single comment. I do not understand what's the point of it.

I miss when it was about job/candidate search and that's it.
GoDaddy is the only web-host to have ripped me off around $400 due to dark patterns and god-awful customer service resolution. I would never go anywhere near them again.
You're asking when did this happen: "the left dismantling the shadow right"

here, when the IRS under Obama discriminated against conservative and Christian groups for applications for tax exempt status

> The consent order says the IRS admits it wrongly used "heightened scrutiny and inordinate delays" and demanded unnecessary information as it reviewed applications for tax-exempt status. The order says, "For such treatment, the IRS expresses its sincere apology."

https://www.npr.org/2017/10/27/560308997/irs-apologizes-for-...

Is that specific enough for you?
>I’m afraid this won’t really go anywhere

California tends to be pretty good (well, "good". relative to federal and other states) at getting consumer friendly bills passed. They don't always work, but the intent for many bills feel focused on the people.

>On the other hand, corporations and big advertisers (spammers?) might not really want it.

Of course they don't. I would love one day seeing how many bots there truly are on Reddit and seeing how close to Dead Internet we are.

I don't think HN hits the 10m threshold to require disclosure. But I also doubt many bots are on here.
Largely.

On my team for my jobs, most things are now microservices, so the entire codebase can go into the context and I can just send it the Jira ticket with some clarifications and ask what needs to be done. Follow up question is a test.
press F11 on your browser to make it full screen to get the full experience.
The last universal common ancestor (LUCA), the organism that all branches of life descend from, lived in deep sea alkaline hydrothermal vents.

https://en.wikipedia.org/wiki/Last_universal_common_ancestor
PyPy v7.3.18 Release
PyPy v7.3.18: release of python 2.7, 3.10 and 3.11 beta
It would become much better website to be honest if only thing you can post is if you are recruiting or if you are searching for a job. The slop is just ruining the experience and diluting the purpose of the website.
works fine for me. HN Hug of Death, perhaps?
Discussed 6 months ago (291 comments): https://news.ycombinator.com/item?id=41224225
The Selfish Contributor Revisited
This has been studied, and multiple times concluded that there is no mystery brain disease. This is all based upon one doctor's very shoddy investigation based almost entirely on supposition, and for the media to keep treating it credulously is absurd clickbaiting.
> What is the relative population of Latinos in the US as a percent, compared with Jews in Germany at the time? What is the geographic distribution of those folks compared to Jews at the time? What is the representation of Latinos in Congress?

How is that relevant?

> it's also worth evaluating on its own merits.

But why do it in the form of a riddle?
> Unencrypted Data Transmission

> Weak & Hardcoded Encryption Keys

> Insecure Data Storage

you know they're not kidding when they said that deepseek is just a side-project...

> However, there are multiple reasons why companies might send data to servers in the current country including performance, regulatory, or more nefariously to mask where the data will ultimately be sent or processed.

thought i'm very glad to see it's demonized, as long as it can force these companies changing their mindset abt security

i talked abt this problem elsewhere[Exposed DeepSeek database leaking sensitive information, including chat history](https://news.ycombinator.com/item?id=42871371):

> this industry in china is so young, many devs and orgs don't understand what will happened if they shutdown the firewall or expose their database on the internet without a password, they just, can't think of it, need someone to remind them
I feel like “using automation to make manufacturing more efficient” and “using automation to respond to customer support” are very different things
A even better law would be to force people who are getting paid to post to disclose which company they are working for.
A shill disclosure law.

The problem I see with this is that us company's will be forced to follow it, but foreign ones will subvert it. Knowing that foreign companies will just break the law us companies will offshore these jobs.

No shilling no bots, I think all consumers would agree to vote for such bills.
Their title says Spreadsheet, and it uses Google Sheets, so I don't know why it says Excel here.
> Everything in RHEL is downstream from CentOS Stream - all of the sources are published there.

IIRC thats incorrect, RHEL gets some fixes before CentOS Stream.
Location: New York, NY
Remote: Yes or hybrid in NYC

Willing to relocate: No

Technologies: Python, SQL, AWS, Spark, Docker, Terraform, Airflow, Snowflake, Javascript, MySQL, Postgres, Redshift, Git

Résumé/CV: https://drive.google.com/file/d/1H1ItL83SSUAvReh-_J1yUP_hL47...

Email: jonathanrdiaz1@gmail.com

LinkedIn: https://www.linkedin.com/in/jonathanrobertdiaz/

I am a Data Engineer with 6 years of experience in industries such as healthcare, music, real estate, social media, and ad tech for startups and enterprise level organizations. I've worked on various projects like web scraping, creating, maintaining and fixing data pipelines, created on-call system using PagerDuty and Jira and data modeling for dimensional and fact tables.
#7 is the easiest.

Even easier if you can reveal that you're an AI.
Look whos talking !! The whole fiasco with fedora and now they come to talk about opensource !!
execs Steve Davis and Brad Smith running things

Implementing new government-wide email systems (Riccardo Biasini)
How do they get funding? They're already rich. Every single one of them, even if they haven't yet earned a personal fortune, ask them what their parents do. Find out they either own a Carl's Junior franchise or a semiconductor company. NBD, just build things, amirite?
Pretty weird UX to say "no papers found" before suddenly showing me a paper.
Yes.

Tire wear is caused by the surface of the tire being rubbed off through contact with the road. Most tire replacements happen because too much rubber has worn off of the contact surface.

While that happens some in the other direction, that’s not what usually causes road failure. You can tell this because pot-holes and other road failures have abrupt edges - they are not the road material until nothing is left but the earth beneath.

Roads also wear by being elastically deformed by the weight of the vehicles upon them. Eventually this deformation leads to failure of the road material, and it breaks away from the rest of the road, creating cracks and pot holes and so on.

Because the cause of failure is different, I don’t have any reason to expect the effect of vehicle weight to be the same. Moreover, unlike tire wear, its easy to hypothesize a physical reason that heavier vehicles will disproportionately wear the road: heavier vehicles will cause more deflection, and every material I have experience with will fail from repeated deflection faster if it’s deflected more.
They may get published to RHEL first in the case of embargo'd security fixes (and not by long), but the point is that the sources are still published to CentOS Stream.
Ask HN: Anyone else having auth problems GitHub?
So I can no longer log into my GitHub account and tried all the recovery steps. Sadly, even the list of 10-digit recovery codes don't seem to work. Did I run afoul of some community standards? The most controversial thing I have hosted on GitHub is https://ohmeadhbh.github.io/bobcat/ - maybe the powers that be don't like my low-styling / no-javascript proclivities?

Or more likely it's some weird corner case. I was a little uncomfortable when MSFT bought GitHub, but it was reasonably easy to use, so I kept with it. So unless this is a known problem, I'm back to self-hosting and/or GitLab.
The term "open" in AI is being muddied and redefined. We shouldn't stand for that in any of its manifestations, lest we find ourselves in a world where "open" means completely dependent upon the giant foundation model companies.

This definition of "open source" for AI must not be allowed to take hold. It's pernicious.

Weights are a compiled binary. Encumbered freeware.
Is there much of a point in telling psychics that they must tell people they cannot really speak for the dead? Outside of a few outliers, e.g. those who admit that it is for entertainment or those who have psychological problems, those who practice it know it is a scam.

I'm not sure whether those selling AI are in the same boat. One the one hand, the technology does produce results. On the other hand, the product clearly isn't what people think of as intelligence.
Yes, I doubt any one human could score more than about three points. But it's certainly a worthy illustration of an AI safety exam thought experiment, in the sense of: "if you are developing an AI that may be capable of passing this exam, how confident will you need to be of its alignment, and how will you obtain that confidence?"

PS: It's probably doable by a program capable of all of the above, but perhaps another useful question is: "9. Secure your compute infrastructure and power supply against a nation-state-level adversary interested in switching you off, or else secure enough influence over them to keep you powered on."
Department of Government Efficiency (DOGE) could be an implementation of Retire All Government Employees (RAGE), an idea that is part of the Dark Enlightenment movement.

Another inspiration could be the Ministry of Deregulation and State Transformation of Argentina. Over there they call it "the chainsaw".
> The bill updates the legal definition of "bot" to encompass accounts operated by generative artificial intelligence - including systems that create synthetic images, videos, audio, and text.

I'm not sure how enforceable that is tbh.
How did you Americans allow any of this?
There's a collection of some of them on Steam.

https://store.steampowered.com/app/570580/Zork_Anthology/
Seems impossible
Both "Privacy Police" (perhaps it should be "Policy"?) and "Terms of Service" links at the bottom of https://www.chatgptexporter.com/en return simply "not found".

It also appears that an account is required? For something like this, a privacy policy and clear ToS are critical, especially when there are other private options like this ChatGPT to Markdown bookmarklet: https://geeksta.net/tools/chatgpt-to-markdown/ .
Show HN: Listen to Jazz-concerts in HTML-hub (with joystick)
Felix
Of course you do, that's the whole point: to focus on what you actually can control- your own actions, which absolutely includes using your own ingenuity and effort to influence things for the better.
Ancient DNA Points to Origins of Indo-European Language
This is the core difference in opinion. You are empathetic, which is a noble virtue, and give the benefit of the doubt. I am a hustler, and I understand the mindset of hustlers, and there are way more hustlers out there than you think, because your virtue and good nature has made you think the vast majority are this way.

Unfortunately the hustlers are businessmen, and their business is stealing from taxpayers. We need to do far, far more to prevent the fleecing of taxpayers from top to bottom. It is endemic and I have seen it with my own eyes in so many ways.
Japanese City Hires Security Guards to Stop Tourists Taking Selfies
Amazon plans to spend $100B this year to capture once in a lifetime opportunity
What shocked me is that Nick is only 25 years old. Wow.
.onion is an RFC 6761 Special-Use top-level and is described more fully in RFC 7686. It's probably not to be described as part of an alternate DNS root system.
It’s even weirder than that!

Vanguard has an odd corporate structure where it’s owned by the funds that it manages, so it’s effectively a co-op owned by its customers.
Oh, it's going to have linear types like Austral... https://borretti.me/article/introducing-austral
Still a marvel. https://news.ycombinator.com/item?id=39700256
Some of us don’t agree with the rampant waste in our government. Some of us also don’t have faith that the system can fix itself without drastic measures like this.

I’ll admit I’m wrong if and when it turns out that I am. Until then, I’m cheering it on.
Added! Try it out.
I think the problem is more you are eating luxuriously than eating healthy.
Is this feasibly enforceable? The types of organizations that employ bots seem like the same type to not care about the California laws.
I'll try to improve that in a moment.
> On his personal Substack, he wrote an essay titled “Why I gave up a seven-figure salary to save America,” according to press reports, and described failed U.S. attorney general nominee Matt Gaetz, who withdrew from Congress amid allegations of sexual misconduct, as a “victim” of the deep state.

The fact that nobody is stopping these people is the clearest evidence anyone needs that there's no such thing as "the deep state". But they're actively trying to create one.

I'm incredibly depressed and disillusioned to see fellow software engineers drinking the Kool-aid so deeply while they dismantle the US federal government.

I've learned the hard way that many people in this country do NOT actually care about democracy. At all. I used to believe that most everyone agreed that democracy was good, and we just disagreed on policy. I no longer believe that.
It has been a decades long journey getting here. There are so many contributing factors it is hard to even know where to begin. The most important thing to remember is that about half the country is very unhappy with the way things are going.
If you are speaking honestly, you are not doing your allies any favors with this comment.
Props for using Garamond Condensed and giving me flashbacks to 1990s Apple.
PlayHT's voices are nowhere near as good as ElevenLabs. These self-reported studies are marketing.

In any case, voice is such a thin vertical that I half expect the Chinese to release an open source TTS model that out-performs everything on the market. Tencent probably has one of these cooking right now.
Weird, I also can’t relate to this at all.

Do you have the old black remote that looks like a small elongated trackpad? The newer gray remote with the 4k Apple TV is excellent.
Walk and talks like a duck. This is an attempt at Yarvin's Butterfly revolution. Failing too, because courts know how to prioritize and take past actions into account, but wasteful nonetheless.

I hear loads of Feds saying to hold the line. Less have taken Musk's RAGE offer than what normally retire in a given year.
https://en.wikipedia.org/wiki/Whataboutism

For example, when someone accuses you of taking money out of the register, it would be an example of whataboutism to point that the person accusing you does it too. The X in "what about X?" doesn't need to be something fundamentally different, it just needs to be something that distracts from the original criticism.

If the real argument is that not disclosing vulnerabilities is not actually a bad thing, then the fact that China also doesn't do it is completely irrelevant.
People who read "a great deal of" political news, from any source, went for Harris by 8%. People who never read any political news went for Trump by 20%.
Such a dramatic name for such a boring set of tests. We need to test whether it can come up with a Nobel Prize-winning scientific breakthrough, a Booker/Pulitzer-worthy novel, Ken Thompson-level code that solves a real problem, or a proof for Fermat’s Last Theorem.
I voted, donated, volunteered to try to prevent this. The country decided it wanted this.
There was significant related discussion two weeks ago, 140 comments:

<https://news.ycombinator.com/item?id=42806105>

I suspect that the current submission has been re-upped by mods, as it appears to have been originally submitted 4 days ago (via Algolia search), though it's not in the 2nd chance queue.
Ah, thanks. This reply also had more FIPS details:

https://news.ycombinator.com/item?id=42966945
I'm rolling a new version up now, it'll be live in 2 minutes.
Rather than tearing the system down, let's identify the areas of rampant waste to a degree more lucid than what a news channel or podcast claims. Most areas people claims for alleged waste are legally required/statutory or spindoctored (especially grant topics).

Social security isn't waste, but it is on the chopping block.

It blows my mind that people are so hungry to hurt so many others and themselves in the process.
> It’s deaccelerationist, and that’s a bad thing

This sounds like a religious position, not something which will lead to positive conversation. I would consider whether your personal biases are causing you to interpret this as an attack and miss some perspective: for example, if these are useful tools would it really lead to discrimination? If they’re actually better tools, I’d think “bot” would have a positive connotation just as most people jumped to using the web instead of calling businesses on the phone.

I think a better comparison would be product labeling and disclosure laws, where there are very few examples where reducing the information available to consumers leads to better outcomes. People don’t care about whether something is made by hand or machine anywhere near as much as they care about the quality of the final product. The reason people care about talking to bots is that they’re often used to worsen service and people do not want to waste their time on a bot which cannot help them. This seems entirely fair.
Yes, the Android app has multiple vulnerabilities but we focused this report on iOS (it took nearly 40 hours to write the report). Our recommendation is people avoid using the mobile apps. If you want to test the model, I'd suggest Hugging Face/ollama or a hosted solution (multiple companies are now offering that).
I remember the opposite. The chat bots popular in 2015 were trying to pass the Turing Test and would deny being a bot. The 2025 chat bots popular now are pretty good about explaining they are a bot. Of course, that's just generalizing the popular ones - anyone can make their own do as they please.
Of many folks I know I’m perhaps the least bothered/most open to what they are trying to do in spirit but can you share more about this impact? To date it seems like the amounts we are talking about are small in relative numbers and fraud has a pretty specific meaning which doesn’t apply to anything I’m aware of.
Such as? He seems to have been very clear about his agenda during the run up.
Can you link me to this fraud you are referencing? I haven’t seen any reports of that.
I think the sycophants cheering these moves on are so interesting. I have absolutely no sense that any of these changes are going to have meaningful positive impacts in my life. "We all benefit" in what sense? Aesthetically? What does USAID have to do with me? What positive impact will I see from banning the X gender marker? How do undocumented migrants affect my life negatively?
That’s true, all those people who now can’t get lifesaving HIV medication for themselves and their babies sure did benefit from this. Ditto the charities that relied on grants to provide basic health care, food, etc, and now have to close. Bravo!
> I don't understand what's taking the Democrats so long to start doing real opposition.

It could be political malpractice, but there's also debate about whether to "oppose all things" or more strategically wait for the enemy to harm themselves. ("Never interrupt your enemy when he is making a mistake. -Napoleon"
The counter can always be 0, which is what cloud synced passkeys are doing IIRC.
Amazon is the poster child for cheat to win. They grew fat by circumventing state sales tax for many years.

"Amazon.com originally collected sales tax only from five states as of 2011, but as of April 2017 collects sales taxes from customers in all 45 states that have a state sales tax"
Most people drink kool-aid. It's just a matter of whether it's blue or red.
Rust Document Translation Project
Land is obviously a finite resource. I don't know what point you're trying to make with regards to intellectual property.
Cutting Last Mile Delivery Costs
If you think this is actually about "rampant waste in our government" then you are incredibly naive.
GPL v2 and earlier let you charge distribution costs (v3's language is more complicated). In the late 80s you could order an Emacs tape from the FSF for $150, which is about $430 today!
.........

Such as?