skysight-inc/HackerNews huggingface dataset:
Show HN: Fixmydocuments.com – Transform any document into an optimized version
A few months ago, I submitted a webapp that lets you take any YouTube video and turn it into a polished written document in markdown format. I got feedback from people that they wanted something that could work for any audio file. Separately from that, I submitted an open-source project (llm_aided_ocr) a few months back that lets you "upgrade" the output of tesseract OCR, using an LLM to correct transcription errors and also to convert the formatting to use markdown. Well, I decided to combine all those features and more in my newest app, called FixMyDocuments.com.

You can submit any kind of document-- PDFs (including scanned PDFs that require OCR), MS Word and Powerpoint files, images, audio files (mp3, m4a, etc.), and turn them into highly optimized versions in nice markdown formatting, from which HTML and PDF versions are automatically generated. Once converted, you can also edit them directly in the site using the built-in markdown editor, where it saves a running revision history and regenerates the PDF/HTML versions.

In addition to just getting the optimized version of the document, you can also generate many other kinds of "derived documents" from the original: interactive multiple choice quizzes that you can actually take and get graded on; slick looking presentation slides as PDF or HTML (using LaTeX and Reveal.js), an in-depth summary, a concept mind map (using Mermaid diagrams) and outline, custom lesson plans where you can select your target audience, a readability analysis and grade-level versions of your original document (good for simplifying concepts for students), Anki Flashcards that you can import directly into the Anki app or use on the site in a nice interface, and more.

For any HTML generated content, you can also host it with one click and you get a unique URL that you can distribute to anyone for viewing, and they don't need to have an account to see it.

This has been a lot more challenging to make than I originally guessed it would be, but I'm pretty pleased with the final output quality, which was a result of tons of prompt engineering and iteration and chaining together different prompts in pipelines. The mind map generation in particular is ~2,700 lines of Python code and involves many dozens if not hundreds of separate LLM inference calls to generate a single mind map from a source document. What I think is interesting about this is that, even though one theoretically could do many of these things using ChatGPT manually, it wouldn't be practical because of the many stages of complex logic involved in combining and transforming the LLM outputs.

There was also a lot of more manual "quality control" filtering/processing involved to remove any traces of the LLM inserting irrelevant text, such as preambles/introductory comments (even when explicitly prompted not to do so).

Anyway, happy to answer any questions people have about it.

You get 100 free credits just for signing up with a Google account, which is enough to process a bunch of modest sized documents. Please give it a try and let me know what you think!
Thanks. Can you clarify what you mean by your last point? One of the main advantages of spark over Hadoop is that it doesn't need to spill to disk/ serialise between steps, i.e. it is pitched as an in memory big data platform, so I'm a bit confused.
If you're trying to get the best and brightest why would you charge 500 thousand dollars?! I don't care what kind of wiz you are, that's prohibitive.
> rather than keeping them around to keep senators happy

To whom are you directing your advice, then? This is like those articles headlined "Donald Trump must resign" -- who is supposed to make that happen? Who with any power over this situation is going to change their mind as a result of that article? Keeping senators and congress happy is literally the point of these programs, no?
Truffle Launches Local AI Agentic Computer
I thought it is a terrible idea from first sentence. Last paragraph completely changed my mind.
Even simpler, file a dispute with your card issuer. Dish will pay the chargeback fee and block you as a customer, but I'm sure you don't want to be their customer again, so that's not a problem.
1-800-ChatGPT
I think the "convenience fee" of online purchases is about the fact that if you want to buy a ticket days before showtime, you don't have to get a physical ticket at the box office in person.

Not necessarily that I agree with it though -- in many parts of the world you have no such fees when you buy a movie ticket online.
> if there is a low supply of workers and a high demand for them

Employers outsource all those works to overseas.
Yep, my s.o. wanted to play skip-bo, which is also a game so simple that it's just luck of the draw, and I lost 7 games straight after lamenting the randomness of it before we even started, which isn't as impressive of a streak as 20 but still, I understand that feeling.
small nit, but why is the bot stopping so far from you? maybe it's the camera angle, but it looks like it wouldn't get within 10ft of either of you.

maybe for safety?
The original developer team, source codes, and build instructions would all be gone by then. Otherwise you should be able to issue a patch. I suppose you can codify code archives and code release enforcement framework in penal codes, like use of components with non-escrowed firmware code or losing access to code felony crimes with long sentences, but that's horrible.
no, just make it an auction system with compensation.
I guess you mean the taxpayer money that the taxpayers are currently paying, against their will, towards unwanted subscriptions that they haven't managed to cancel.
I agree is probably a losing battle, but maybe worth fighting. If the metadata is also encrypted, you can also verify the time and place it was recorded. Of course, this requires closed/locked hardware and still possible to spoof. Not ideal, but some assurances are better than a future of can't trust anything.
Most b2b products are going to need SAML auth. Any reasonably sized tech business will want to onboard their employees into the software through SSO and the easiest way to do that is usually SAML if they are using something like Okta or JumpCloud.

Along with that, if they have compliance requirements like SOC2 then they really want the whole flow including offboarding any employees that have left the company.
Companies like Stellantis are very keen on brands using standardized platforms. I would be very surprised if in the future Volvos weren't using engineered in China Platforms, which are localized for Europe (same for Land Rover with engineered in India).

If Swedish engineers are just developing hats, their influence on crash safety is significantly reduced. Right now Volvo still uses an inhouse platform, where they do actually have control, but it is obviously inefficient to develop numerous similar platforms for different brands.
no, it isn't as far as I'm aware
Sort of but we're not talking about apes and monkeys here, it's placental mammals in general. So the evidence is overwhelming https://en.wikipedia.org/wiki/Mammals_of_Australia#Evolution...

If we got this wrong, most of paleontology is unreliable.
I’ve noticed the use of L-1 visas nowadays.

In my recent conversations with recruiters, they've suggested joining the company and working from my current location, then transferring after a year.
> Felt quite deceptive and totally incomprehensible.

In the case of sales tax, it's deliberate propaganda. "Here's what we would have charged you if it weren't for greedy old Uncle Sam."
You're not missing anything. Other than that, seemingly, STEM roles are the only industry where the laws of supply and demand do not apply, and a positive supply shock of something does not, for some reason, drive down the price.
And this is one of the reasons why I can't buy into the Apple ecosystem. With Android, I would be cut off from all Google stuff but there are more/less work-arounds for those.

But the fact that I have a billing dispute with a company and they are able to hold everything else that bit of technology touches hostage is just wrong. Imagine if you had a billing dispute with the city water company and they cut your city power because of it.
If they were hostile—clearly they're not intending to be secret, since they have bright lights. So if they're not trying to spy, what else might they be doing? The most likely explanation I can think of is, they're trying to provoke a reaction, to see what defenses the US has against hostile drones. So you can take that information and build defenses for your drone.

So maybe shooting them down isn't the best idea, unless they begin to pose a more direct threat.
Checked exceptions feels six of one half dozen of the other to me.
Durability to cost ratio. I can get 90mm borosilicate petri dishes for $10 that I can be pretty certain won't melt into a glop, plus having a "contained" object allows me to have tamper seals that are much harder to violate (nail polish).

Thus, "password recovery material, TOTP QR code, and an SD card with essential documentation" can be passed to next of kin easily.
Assuming what you said was true, it sounds like they knew about it anyways over a year earlier.
> A password safe, I can trivially backup however I wish

Boy do I have good news for you then. Passkeys can often be stored in many available password safes. Bitwarden, KeepassXC, LastPass, 1Password, Dashlane, and more all support passkeys. Make one on whatever device, one in your password safe, and you'll have redundancy.

And I'm not talking about people needing to carry two $1,000 phones or a $1,000 phone and a $1,000 laptop. You could have your second key be a small, cheap (<$40), durable authenticator. Another thing on a keychain, another card in a wallet. Really that big of a deal?

And if that's truly impossible for you, then sure I'll agree passkeys might not be for you. I agree, some people like those who are homeless have a hard time keeping any material goods safe. I'm not arguing every account for every person needs to be only passkeys. But people here are acting like it's something impossible for nearly anyone to use safely. And I don't think that's based in reality. I think a lot of people could use them safely if they wanted to, but there's a massive amount of FUD about them.
https://www.perplexity.ai/hub/blog/welcoming-carbon-to-the-p...

Official announcement.

Looks like glean has some competition

>Rather than making users search through many different web pages, apps, and messages to find the answer they're looking for, we see a future where Perplexity does the research for you, bringing the most critical insights across sources together as part of the answer. Carbon will simplify the process for our users to connect the data sources that matter to them.
I thought that was specifically for when you were waiting for the residency permit, not a random H4.
I hate that it is time restricted at all. Just make it a green card program with a path to citizenship outright. Brain drain the rest of the world. Instead we are providing work experience to our future competitors.
We can look at the number of infections per year to quantify the effectiveness of the regulations. In the US there are approx 1.35 million per year [0], i.e. 1 in 255 people, with around 450 deaths. In the EU there are approx 70k reported cases [1] i.e. 1 in 6500, with around 90 deaths. Moreover the number of cases drastically dropped in the EU since regulations came into force earlier this century. The data here is very clear that regulations save lives.

[0] https://www.cdc.gov/salmonella/index.html

[1] https://www.cdc.gov/salmonella/index.html
...this is also the problem with passkeys. It makes it so much harder to move to a new device, and easier to get locked out.
Microsoft won't let customers opt out of passkey push
How much of a difference does it make to use Coreboot rather than AMI? (I'm running OPNsense on a Protectli box currently...)
It’s always funny to see blog posts that talk about CI, ephemeral environments, containers, Bazel as the solution to CI.

This blog post matches my experience of running a CI system (but at a smaller scale). It’s messy, and throwing more resources and money at the problem often shows significantly diminishing returns for massive cost spends.

I’d love to someday try and fix this problem for other companies.
I am not a legal scholar, but from my understanding enough that serious cases were filed and fought and made in all the way to the Supreme Court.

In a https://www.scotusblog.com article, Amy Howe quotes the Chief Justice as saying "Chevron deference, Roberts explained in his opinion for the court on Friday, is inconsistent with the Administrative Procedure Act, a federal law that sets out the procedures that federal agencies must follow as well as instructions for courts to review actions by those agencies. The APA, Roberts noted, directs courts to “decide legal questions by applying their own judgment” and therefore “makes clear that agency interpretations of statutes — like agency interpretations of the Constitution — are not entitled to deference. Under the APA,” Roberts concluded, “it thus remains the responsibility of the court to decide whether the law means what the agency says."

I ought to go read the decision for myself, which I have to this point not yet done. I am not an attorney, but do have a general interest in these matters.

But back to the earlier poster's notes, ATF has been a prime example. They have a history of capricious reinterpretation at the whims of whichever administration is in power. They issue letters to people and businesses that say one thing is okay and then outlaw in without any law changes a decade later. I have never owned a pistol brace, but they stated it was an acceptable innovation for certain applications, thousands and thousands of people relied on that, they issue a rule making comment period and get feedback and then threw all of that out and came out with a final rule that bore no resemblance to the one in the comment period. Then they stand behind Chevron that the courts had to listen to their interpretation. It is legal "heads, I win" and "tails, you lose!"
Guy who born with natural citizenship is too privileged to imagine how hard it is to get a green card.
Unfortunately, that's a big challenge for a volumetric display, particularly a spinning one. There's a mass problem (heavier spinny things are more difficult than lightweight spinny things). There's also a wire problem if the elements on the spinning element are active and need to be addressed, since the wires generally need to come through the hub. If a projector is used and the spinning element is passive, then there's a tricky alignment issue.

And in any case, there's a bandwidth issue, since every 3d point is now addressed by a 1D or 2D array. That's an enormous amount of the data that ultimately needs to be uncompressed by the time it hits the display hardware.
Didn’t the rule change last year where all applications by same person is considered as one?
Yep, that's what I meant. Sorry!
Seikos are great. I just wish they'd put spring drive into a lot of their cheaper watches.

The majority of expensive watches, even handmade, are only so expensive because of brand...or the fact that the case is solid fucking platinum/gold. That's cheating!
As a senior software engineer who was unemployed for over a year, I can confirm almost nobody is hiring USA Javascript and Python devs with 10+ years of experience with some big accomplishments. I got lucky with a backfill.
There are always new security vulnerabilities found on these network devices and they directly face the internet. Most of these companies tend to EOL them after a few years and often continue to sell that close to or after the EOL date.

This link is from a quick query on dlink routers.

https://unit42.paloaltonetworks.com/6-new-d-link-vulnerabili...
To me, it is a boiling frog situation where each incremental loss of privacy is no big deal and nobody is actually looking at my data in particular so I don't care at all about that. And I don't care about my own privacy beyond any average person and I don't use any tools to hide my identity or whatever.

The worry is not a personal one, or even a systemic one, but a concern over the general direction of data availability and societal fragility.

Take, for example, the drone scare in NJ right now. The problem isn't what the drones are doing but the potential they have to do any number of harmful or invasive things. Right now I can go to Costco and buy a drone with an HD camera and hover it outside your bedroom window. Or have it sprinkle anthrax on your head when you walk outside your apartment.

The problem is that technological advancement far outpaces our ability to reason or control its usage effectively. Regulation lags misuse and eventually something (drones, nanobots, whatever) is going to lead to a massive and irreversible calamity before we change our starry-eyed rush to embrace the "new".

Sometimes I think the Amish have the right approach, though a little extreme. They aren't 100% anti-technology but meet every year to vote on if something new should be adopted, only after considering all negatives and secondary effects.

I am a realist, though, so I just live my life and brace for the eventual impact.
I’d go with Aruba instant on.

https://www.arubainstanton.com/
True, maybe you can find a test which asks, instead of a single button click, to click one of 4 possibilities for a reaction?

EDIT: see appendix A.3 Perception
It's funny, because when I buy from China, their stores have little trouble estimating my country's import tax, and my state's selling tax. But US physical stores can't manage to put the final price on their tags.
By offering wages appropriate for the economy your fellow citizens are accustomed to, as opposed to the economy citizens of other nations are accustomed to.
I believe that's the O-1 visa, not the H-1B.
The tools, even if made illegal (which I think is inevitable long term) will still be there.

My worry is that avoiding mass surveillance will require the level of disengagement from society that is too extreme to be sustainable for the vast majority of people concerned about said surveillance.

And I would further argue that this is already the case.
I skimmed over the paper so sorry if I didn't see it, but isn't the most obvious answer that (at least conscious) human decision making happens at a high level of abstraction? Information output or processing in terms of bits, say the numbers of words in a sentence, isn't equivalent to the meaning or effect that has in the world, which is what matters.

If a general orders an army to go to war that's a few bits of text on a piece of paper, but obviously that bears no relation to the consequence of what that puts into motion in the real world. It's not like we spend most of our days speedcubing or writing and reading the dictionary. We aren't low level data processors even though that might happen unconsciously somewhere in the sensory system, but the conscious mind is a reasoning system.

Even in artificial systems is that visible, from Deepmind on Alpha Zero (https://deepmind.google/discover/blog/alphazero-shedding-new...)

"For each move, AlphaZero searches only a small fraction of the positions considered by traditional chess engines. In Chess, for example, it searches only 60 thousand positions per second in chess, compared to roughly 60 million for Stockfish."

Not too draw to many parallels between the human brain and these systems, but they do obviously share the similarity that higher order conceptual decision making compared to just data processing will result in lower rates of decision making at at least the top level. That's for me what you'd expect to happen, not a paradox.
> Information released by the FSIS in response to multiple Freedom of Information Requests revealed that the agency had been aware of major deficiencies at the Boar’s Head production facility since October 2022, but had taken no action to suspend production or order a clean-up. These deficiences [sic] were described as posing an “imminent threat to product” in a Food Safety Assessment conducted in September/October 2022

What's somewhat disturbing is that there are politicians that think that it should work that way all the time.

I don't remember the specific states, but remember reading that some state legislatures were upset that county health officials had been able to close in-person dining at restaurants during the height of the pandemic and had changed their laws so that county health officials could no longer close a restaurant for health code violations unless the health officials could demonstrate someone had actually been seriously sickened by the violation.
That's nice for finding Keywords, but dismantling a chat discussion, which probably consists of many parallel threads in a channel, isn't easy.
This sounds like nothing more than pwning the libs, so I read the underlying article for the ostensible reason. Which turns out to be "too much China in the supply chain", as if somehow ICE cars were somehow free of Chinese parts and resources.

In other words, yeah, it's pwning the libs. Musk is perfectly happy since the government was mostly buying non-Tesla electric vehicles (like the new postal delivery trucks).
We all know how a distant deadline can make us slack off. Then suddenly the deadline is in three months instead of four years, you’ll discover a bunch of things you could do faster.

That’s not to excuse the slowness, but I imagine this stuff was in process for a while.
Good luck to you.

In my experience the web is a huge pain in the butt. But since it's there (and its convenient for distribution) it is an expected target for an engine like this.

But really the problems that I've experienced are:

- de facto tooling (Emscripten) is very immature and poorly documented. Everything "just works" when it doesn't or when it "works" the semantics are completely different. For example async file APIs. Every update of Emscripten breaks something.

- The Web has nerfed a lot of APIs. For example to use "threads" aka web workers you need SharedArrayBuffers and for those you need to enable several web policies. A massive deployment pain.

- The Web APIs are often poorly thought out such as pointer locking. Why can't I just hide my cursor when it's on some particular element? LockPointerSendEmailToMom type of situation here. Full screen APIs, audio context uh uh.. and to make things worse every browser has its own quirks.

- The Web APIs have tremendous performance degradation compared to running native. Your rendering calls must be optimized. Your unoptimized code might run natively at 2000 fps but when you run in WASM against WebGL you'll have hick-ups at 60fps.

- Timing is hard, RAF really sucks and you have continuous little delta jitters that cause micro stutter.

- WASM raw performance might be okay-ish but by itself it's useless because you need to interact with the APIs such as WebGL, WebAudio etc. to make anything actually useful. Keep in mind every WebGL probably executes around 1m lines of code at least and does several IPC handoffs to get to the browsers rendering / GPU process (in chrome). Heck, native audio buffers 20ms are fine, on the web though... you'll need more like +100ms. Terrible.

Bonus tip, if you're on Emscripten definitely don't bother with their OpenAL audio api. I'd recommend to use WebAudio. Sokol has a pretty workable wrapper for that.

Source for all this:

https://github.com/ensisoft/detonator
I'm not saying that the limit should be $0. The Canadian limit of $2000 per voter seems reasonable to me. You can print a lot of pamphlets for $2000.