skysight-inc/HackerNews huggingface dataset:
I was trying to figure out this exact same issue. OCR on a PDF worked great, up until a certain point when it just started hallucinating like crazy. I was working on a whole pipeline to just feed in a PDF one page at a time to try and get around this issue. Otherwise, the OCR works absolutely fantastic compared to all other other tools I've been trying lately. These include OCRmyPDF (Tesseract), SuryaOCR, and some of the models on the Visual LLM Leaderboard.

I've also seen some people recommend Paddle OCR, but I find their documentation to be lacking and I haven't got that one working yet to evaluate.
From a somewhat outside perspective, I used to think that being a tenured professor at one of a relative handful of top institutions would be a pretty nice gig overall with at least decent pay and benefits. Over time, I came to think I probably wouldn't have liked it a lot even given that very optimistic hypothetical situation.
Show HN: We built an investment management tool for retail investors
I'm developing an investment management tool, Stockle, for retail investors with a co-developer. The idea is to enable investors to manage, track, and analyze their holdings and transactions in an organized manner.

Having multiple transactions in various currencies and accounts can quickly become a big headache. On top of this, many investors utilize multiple brokers and even manage their family members' accounts.

If you are a developer, you may be familiar with Linear as a project management tool that completely changed developers' views on how managing tasks should feel.

What we want for investors is to help them be as organized as developers using well-designed project management tools.
"During the Renaissance period, hands were as important a focus of attention as the face was, because they were the only other visible area of the body."

[Example painting is a Titian with a naked Mary Magdalene]
Ask HN: Is anyone using Pocketbase to build a back end?
I'm wondering if you already used this tool to build a backend. And for which type of backend ?
I went through a similar journey back when GPT-4V came out. Here's an additional puzzle for you: GPT-4V knows the exact pixel dimensions of the image (post-resize since there is a max size for images in the pipeline, besides 512x512), but I'm 99% sure it's not provided as text tokens. How am I so sure? It's easy to get GPT to divulge everything from system prompt to tool details, etc. but I've tried every trick in the book and then some, multiple times over, and there is no way to get it to quote the dimensions as text. The only way to get it to give you the dimensions is to tell it to output a structure that contains width and height and just pick something reasonable, and they will "randomly" be the correct values:

https://x.com/blixt/status/1722298733470024076
every expert i talk to says: „LLMs are not good for my domain, but for $other_domain“
Show HN: Boom – A way simpler OBS alternative for macOS
I got sick of people complaining about Zoom fatigue. I assumed these tools would eventually fix the UX of remote meetings, but that never happened.

After leaving Shopify, a few of us created Boom to inject energy back into video calls.

Boom is a virtual camera that adds overlays to the camera feed, allowing users to display their name, title, logo, GIFs, and even their local weather. Users can touch up their appearance using camera filters like saturation and brightness. They can also use global keyboard shortcuts to mute or start a screen share automatically in Zoom and Meet.

Privacy was a big concern for us too. All of the video processing is done locally and we don’t have access to any of the meeting information, like who attended or what was discussed.

Let us know what you think (and feel free to roast us).

Krishna
Nintendo/Google news: https://www.404media.co/google-leak-reveals-thousands-of-pri...

Unblocked: https://archive.is/RXEjf
> It is never more important than now to remember that. War is horrible. It is our collective responsibility to promote reason, compassion and peace in the hope of preventing as much war as we can.

Agreed, though...

"When the last person who remembers the last great war is dead, the next great war becomes inevitable."

https://apnews.com/article/d-day-france-russia-ukraine-wwii-...

I fear we're entering a risky time.
I agree with all but last statement

> and your goal is to terrify enemy civilians, which is not a legitimate military strategy

That just doesnt work, pretty much never. Yes civilians will be terrified but that is all you will achieve. It holds true during 2nd world war, it holds true now with every single ongoing conflict.

Going after civilians changes nothing, often results in the opposite - even harder resistance.
Are there any plans to support the features? Or is it just not a direction for the devs?
You need https://apps.apple.com/us/app/say-no-to-notch/id1639306886?m...
If you just want background music that won't set off any DMCA alarms use one of the generative AI music tools. Even the examples and 10-second tests are probably good enough (just loop them), LOL

By law they can't be copyrighted since they were generated by AI.
Of course TPMs can be (ab)used for DRM, but the same property in general to many ideas in cryptography. We still don't say AES or RSA are tools designed to restrict your rights.

AES and RSA are just algorithms, not implementations. I'd compare TPMs to HDCP, AACS, or CSS (the DVD one) instead.
I really hope we see improvements to the resolutions large multimodal models can handle. Right now this patchwork approach leads to lots of unwieldly workarounds in applications.
My only concern is that actually the big guys get the big cut, and the DJ and the original artists (that are not wildly popular) the shortest end of the stick.
Are there all that were implemented or only the ones actually observed?
The restricted geometry means that Starlink is the only constellation with enough coverage to keep the link up (and even then it can't get a connection for moments of the decent). It's completely accurate to say that only Starship and Starlink could pull this off. You would have to imagine a fictional constellation to say "any satelite can communicate".
The Extravehicular Activity (Eva) Suit [video]
So the PWE is the new bogeyman?
This looks great.

The authors randomly permute (i.e., shuffle) input tokens in training and add two positional encodings to each token: one with the token's position and another with the position of the token to be predicted. Otherwise, the model is a standard autoregressive GPT. The consequences of this seemingly "simple" modification are significant:

* The authors can prompt the trained model with part of a sequence and then decode the missing tokens, all at once, in parallel, regardless of order -- i.e., the model can in-fill in parallel.

* The authors can compute conditional probability densities for every missing token in a sequence, again in parallel, i.e., densities for all missing tokens at once.

* The authors propose a rejection-sampling method for generating in-fill tokens, again in parallel. Their method seems to work well in practice.

I've added this to my reading list. Thank you for sharing it on HN.
I share your skepticism. But I'm trying (forcing) myself to keep an open mind so I don't want to completely dismiss the strategy. I listened on a podcast where a crypto algo trader said he's been using it successfully in his fund: https://bettersystemtrader.com/algorithmic-crypto-trading/

I've also heard on that podcast a good explanation for why traders bother selling courses even if they're good at their jobs. Trading is volatile, so you want to acquire alternative income streams. I think that's a point that any entrepreneur would find reasonable.
Clippy from MSFT? this is where the techies really lose perspective.. you see, its not just a computer, a computer company, and a user.. Real life includes social systems with social contract, and the relationship of the user's logs, records and autonomy to the "master" of the economic relationship. Microsoft has made it clear that surveilling the user and restricting autonomy is as valuable or more valuable from a business perspective than the actual actions performed, AND at the same time, entire industry product lines are designed to trivialize and factor out personal skill and make job performance more like replaceable piece-work.

Lastly, people are more or less aware of these other dynamics at work. Yet, people are people and respond to other social cues. The sheer popularity of something being novel, cute or especially "cool" does move the needle about adoption and implementation. Clippy was a direct marketing response to Apple getting "cool" ratings with innovative GUI elements.
C++ programmer's guide to undefined behavior
You can use Microlink to turn PDF into HTML, and combine it with other service for processing the text data.

Here an example turning a arxiv paper into real text:

https://api.microlink.io/?data.html.selector=html&embed=html...

It looks like PDF, but it you open devtools you can see it's actually a very precise HTML representation.
ThrottleStop is your friend.
You are welcome.

This is not a corner case (SSN required, not card). I would say its more like 90%. Since 2021 nobody needs proof of SSN, they just need the SSN number itself.

To quote CA DMV website:

> Applying for a REAL ID requires proof of identity, proof of California residency, and a trip to DMV. You will be asked to provide your Social Security number on your REAL ID application (exceptions may apply).

https://www.dmv.ca.gov/portal/driver-licenses-identification....
Hitler also had the same hand gesture in his portrait by Heinrich Knirr
How to Spot a Deepfake
> If any of you are heading to Disney World you should stop by the NASA Kennedy Visitor Complex

To hell with Disney. KSC is a lot more interesting. And much cheaper.

And, with SpaceX's increased launch cadence, the odds of watching a rocket launch for free increase dramatically from the shuttle era.
Rage converted, yes. Looks like the cpu is air cooled on top of two other computers, an ups, and maybe a third or more accessory computers. All inside a bathroom with probably poor ventilation. None of my bathrooms have return air. Maybe too many heat sources in too small of a space.

A server guy I follow put in a mini-split into his server room to handle the extra load of ~ $100/mo electricity worth of server hardware.

I water cooled my cpu and considered a second loop for gpu but found it was un-necessary according to some research. My new problem is airflow to the office due to heat and no return air in that room either. I run a vornado fan and propped the door open a specific amount where it wants to suck the door closed. It seems to work for now but I’m also looking into a mini-split or air duct booster as my office is the hottest room of the place.
But they do document that the images are resized and give you some rough guidelines on how you should be sizing your images. Low resolution is 1024 x 1024 with no tiling and High Resolution starts at 2048 x 2048 which then gets tiled. It could use further documentation but it is enough to know more than one page should never be used via the API.
Common law countries in general as well. You're not supposed to be able to rewrite a contract arbitrarily, nor can you simply write into a contract that you can rewrite it at will. In common law, that theoretically makes it not a contract in the first place.

For that reason, if you raise the right kind of fuss and raise it to their legal team, the legal team will almost certainly let you out for free rather than run the risk of getting their contract invalidated to any degree in a court of law. I speak here generally in such countries, not just for Adobe.

However, this is theory. The rule of law is generally declining in the West. Your mileage may vary in any specific attempt.
you can fit a lot in 1 system prompt. i would instead put it all in the main system prompt, at least until openai comes up with a better ux
How do you authenticate RA messages? I mean, can anyone just throw RA messages onto the network?

This seems like the "rogue DHCP" problem in v4.
OP is wrong. Only the number is required, not proof. OP was right in 2018.
Riven VR Trailer [video]
That doesn't invalidate what I said, rather that we could have gotten WebGL 2.0 Compute much sooner than WebGPU if it wasn't for bloody politics among browser vendors.

https://github.com/9ballsyndrome/WebGL_Compute_shader

https://github.com/9ballsyndrome/WebGL_Compute_shader/issues...

https://issues.chromium.org/issues/40150444

"Intel spearheaded the webgl2-compute context to provide a way to run GPU compute workloads on the web. At the same time, the WebGPU effort at the W3C aimed to design a new, lower-level graphics API, including GPU compute. The webgl2-compute approach encountered some technical barriers, including that macOS' OpenGL implementation never supported compute shaders, meaning that it wasn't easily portable. webgl2-compute has so far been used by customers for prototyping.

At present, WebGPU is close to shipment, and its shader pipeline is nearing completion. It's possible to run combined GPU rendering and compute workloads in WebGPU.

In order to reclaim code space in Chromium's installer that is needed by WebGPU, the webgl2-compute context must be removed."

Because webgl2-compute took soooo much space on the installer!

And it isn't as if Google isn't doing WebGPU compute on top of DirectX on Windows, but doing it on top of Metal on Apple, unthinkable!

By the way, where are the Safari and Firefox implementations of WebGPU compute, running on stable without browser flags?
+1 like in google+? :D
Don't feel obligated to answer if you shouldn't, but how seriously is Nvidia taking Linux nowadays? With the rise of ML is linux being seen as an important support target?
It’s been that way forever. In CS most colleges have always been about 2 beats behind current industry.
I guess I get it, but if you can alias the package name when you import then it seems like a non-issue.
I’ve been using NearlyFreeSpeech.NET since for 15 years or so and have never needed to consider moving.
Inter-species brain size similarity isn't a large behavioral correlation. It's fun to ponder, though.
For 2), how do you tell the difference between a building that is truly abandoned, and one that has just been bought and the new owner is in the process of arranging to repair and upgrade it?

Unless you are going to setup surveillance and track every footprint, there is a LOT of process before the hammers start swinging.
on the other hand, we should be able to search by concept
Not true at all - experienced thru hikers blow that out of the water
It’s a niche area of interest, I don’t enjoy it because of heavy moderation. My opinion is that it provides value by furthering knowledge of folks in engineering.

Heavy moderation is a technique that makes dang’s job easier by perpetuating rigorous standards and makes people police themselves. See Broken Window Theory.
Are there any good, instructive open source examples of custom libc replacements you could link? Especially ones that circumvent the single-threaded assumption of libc; I'd love to use the code to educate myself.
See also https://news.ycombinator.com/item?id=40605970
Speaking of clobbering each other, min and max are names I had used for variables and functions all over the place. Suddenly they go and add global generic min/max functions and I'm shadowing like crazy.

I still don't understand why they aren't in a package, or better yet why they didn't just make math.Min and math.Max generic?
I did something similar when GPT-4V came out, partially with the goal to figure out the input format (I did not get anywhere other than "magic vectors"), but also to roughly estimate the amount of data you can get back out of a 512x512 (the low quality option) image.

What I found is that you can sometimes get more text out of 85-token image than you can out of 85 tokens of text! That said, I think there will be plenty of edge cases where it actually loses some information, and maybe you could argue that if you remove every other word in the text, it could still restore the text.

I never went deeper on this, but I believe there's something clever to be done in the context window with the fact that images are relatively cheap tokens-wise.
>but that is the ugliest homelab setup I’ve ever seen

Is there a requirement for a homelab to be good looking to outsiders?
ANGLE is such a pain to build, I've never managed to do it.
I'm assuming that the tokens used to encode an image are entirely distinct from the tokens used to encode text. Does anyone know if this is actually the case?
Seriously. It's losing many weeks of your life to retrain in alternatives to Premiere, Illustrator, Photoshop, After Effects. If not months.

Not to mention it's often simply not a choice at all, because you have to collaborate with people who only work in those file formats.
For document text/table extraction, nothing beats the quality from the cloud providers. It can get costly but the accuracy is much higher than what you will find using an openai API.
Seems like this might be used as an alternative to embeddings for creating semantic search. Run a document collection through this to get the activations, run the prompt through the same thing and use the sparse autoencoder to identify which documents has the most activation of features in common with features that the prompt activates. You don't have to know what the features are, but if the prompt includes, say a rhetorical question, it may be able to find documents that also includes rhetorical questions. Not sure how well this would work, but it seems like something that could be interesting to try.
He doesn't give many Star Trek vibes though. Space Socialism isn't really his thing.

What he could do (and Blue Danube yesterday gave me the idea) is to buy the PanAm brand and do a rebrand of the crew services at least to the ISS.
The platform could scan the commit and hide it before it gets displayed publicly.

Totally agree wallets with any real amount of money should probably not be on disk
Sometimes i might turn out to be a good experience
Converting Traditional Hail Size Descriptions
I built an open-source project to recommend the best computing resource configuration for ai application, but no reply or feedback at all. So I wonder if AI application developers care about their GPU utilization now? Or did I target the wrong audience?
Author claims that the most likely is that there is Tesseract running behind ChatGPT-4v/o.

There is no way that this is Tesseract.

-> Tesseract accuracy is very low, it can barely do OCR on printed documents.
The Spanish population in general ain't that good when it comes to English and the quality of living in Spain is, in general, quite good. Weather and food are hard to replace.

Which begs the question: "Well why don't they work remotely from Spain then?" and the answer to that is that the Spanish IT sector does a whole lot of that to begin with, so a business in the market for it can just hire one of the many consulting business there.
Here's a question for those of you with an investment mindset:

The past two years have shown that we're more likely than not heading towards a climate collapse.

I see no serious reaction from the markets, which seem to be assuming a business-as-usual scenario economically.

I find this extremely difficult to believe and I don't see people publicly talking about a future with dramatically higher food insecurity and just a higher baseline cost for existing.

What's the deal? Just collective denial?
Can't speak for GP, but I have similar feelings... some things are dramatically harder, others easier... for the most part I just develop coping mechanisms for as much as I can and try to accept other pieces. Not a matter of self-hatred or celebration so much. Though I have dealt with a lot of depression in my life from a general difficulty in interaction.

One can reason their way through a lot of things, even a lot of the why's of emotion over time. To recognize when you are going into a state of reacting on emotion over reason. It's hard.

My daughter faces a lot of similar issues and it's harder for her than it was for me. The best I can do is try to instill a sense of drive to adapt and overcome as opposed to just giving up and/or wallowing in things. I wish my parents were better equipped to do this for me. I was close to 40 before a lot of things started to fit together. A few years ago, working with someone that had similar personality issues dialed to 11 so to speak that a lot of things became much more clear.
More than one evidently.

https://duckduckgo.com/?q=Hitler+portrait+by+Heinrich+Knirr&...
> DJs often leverage pre-recorded music from other artists as a critical part of their creative expression

It’s crazy to me that the misconception that DJs are playing original music is still around. Even DJs who also produce music play 90%+ records from other people.
Yeah, they would rather spend their money on Playstation, Nintendo and Microsoft consoles, also no Vulkan.
I recommend to get hands on Hardcore History episodes about the rise and fall of Japan in ww2.

You will get an nuanced perspective on the whole conflict from a lot of angles and all discussions that lead to firebombing/nukes etc.

Those thing didn't happened out of the blue.
That random number generator depends on global mutable variables without any protection against concurrent access. It isn’t suitable for production use.
This looks really clean.

Question: are you planning for this to be an opinionated product or do you see Boom offering similar flexibility as OBS but with simpler setup?
Shippable MVPs were never about trading quality for time to market. That's a misunderstanding, borne from people taking the idea too literally.

You could:

- trade tech debt (future changes are harder) for time to market

- features for time to market

- a bit of usability for time to market

But not quality, never quality if you're going to ship it.
https://imgz.org/i8CEMAJq.png

Create a transparent layer. Paint on it in a colour of your choice. Set layer mode to "darken only" or "lighten only" depending on your background. "Difference" is fun too.

I've been using GIMP for longer than I care to remember and I am painfully aware of what is not great in its UI, which is something that seems to have gotten _worse_ over time. This isn't one of them; to paraphrase, that's just knowing how to use basic features that GIMP and other programs have had since the 1990s.
Indeed, I was going to point out the lack for KVM as well. The same is also very true when it comes to Linux networking stuff. One of the most difficult things I've ever had to do was complicated networking stuff with KVM/qemu VMs when I had nobody to ask or talk to about it. There are enormous swaths of undocumented surface (or lightly documented by a blog post that may or may not be accurate anymore, and is nowhere near comprehensive). One of my biggest hope for LLMs like GPT-4 is the ability to improve on this, though as of right now it hallucinates like mad. The more niche the case, the worse it gets too.
In the US, there is already a wide range of state schools, community colleges, and trade-oriented educational options. (And private universities largely do what they want within legal and financial limits anyway.) I suppose you can always argue that higher ed/trade-oriented training should have even less expensive options but it's mostly private ed in majors that don't really translate to job opportunities that lead to complaints about the price tag.