skysight-inc/HackerNews huggingface dataset:
It's because the singer and songwriter are no longer distinct. Pop used to mean a beautiful new rendition of an Irving Berlin or Cole Porter song. Or a hitherto underappreciated song like "Mack the Knife." Now everyone's writing their own songs and it's a disaster. Few realize this.
What is your motivation for growing in this way? More money? More status? More interesting projects?

I would personally be very reluctant to start hiring employees if I was already successful on my own. You say that one upside is “share responsibility” but I would argue that is not true.

It’s your company, you alone are responsible and you’re now not just responsible for your salary but the salary and livelihood of all your employees.
Everything is an engineering trade-off between classification performance, data requirements (quality and quantity for supervised fine-tuning/training), dev time and inference speed/resources.

You don't always have to do full document extraction. For a pdf form information extraction task, I once implemented a pipelined approach on images that extracts handwritten fields by using a trained segmentation model and a extraction model. You get error percolation but performance was between 85-90 F1, and we had human-in-the-loop for uncertain preds.

However, if top performance is a concern (and you're not dealing with handwritten stuff here) I would look into SotA document extraction models for extracting text, tables, graphs etc like LayoutLMv3 [1]. It's probably something like LayoutLM that OpenAI is using themselves. Every major cloud provider has its own document AI services that have similar performance, so that might get you going faster.

On the extracted text of scientific papers, you will run in to context size issues, so take it into account if using LLM zero-shot approach.

You could go with a chunked topic model approach for this too (BerTopic is a nice starting point).

In any case, it all depends on the specific task (amount of topics to classify), and the engineering trade-offs. Only you have all information to figure that one out.

1. https://huggingface.co/docs/transformers/model_doc/layoutlmv...

2. https://maartengr.github.io/BERTopic/index.html
My point wasn't to derive the best classical strategy, but to describe the problem in simple terms that people who aren't familiar with quantum mechanics could understand. QM is a very academic field, verging on intentionally obtuse, and that keeps non-experts from participating. Cozy if you're entrenched, but not the best for fresh approaches.
I think "doctor" is what fits best in the context provided above, but I am not 100% sure.
They used to have a free tier that they killed out of the blue [0]. The cautionary tale is that you cannot just trust these services, they might change the rules at any given time... You can however learn to deploy your own servers and manage your deployments with FOSS tools like the ones I reference.

0: https://help.heroku.com/RSBRUH58/removal-of-heroku-free-prod...
Sure --- and if you'll buy this, I have a bridge for sale at a special discount just for you.
Beautiful.ai | Fully Remote | USA/Canada | Full-time Series B | 16M Funding | AI Industry | B2B and B2C SaaS

1. Lead Software Engineer - $175k - $250k Base Salary + Equity https://boards.greenhouse.io/beautifulai/jobs/4231312007

2. Product Designer - 110k - 160k Base Salary + Equity https://boards.greenhouse.io/beautifulai/jobs/4192650007
Douglas MacArthur famously killed veterans that were protesting https://www.washingtonpost.com/news/retropolis/wp/2017/07/28...
You could try ingesting your files with open-parse. It analyzes the layout of your documents, converts to markdown and extract tables.

Then you could feed this output to a small model like gpt-3.5 and it should be able to classify the topic quite easily.

Alternatively you could convert the pdf to images and feed that to a model. Or use naive text splitting implemented by something like LlamaIndex. Ton of options!

Disclaimer: (I’m the author)

https://github.com/Filimoa/open-parse
I'm writing this on a BeeLink (running Linux) that I use in conjunction with an M1 Air. It just works for most use cases (but only very light gaming).
I also recently analyzed the binary encoding of a baby toy.

https://aaron.axvigs.com/content/leapfrog-fridge-phonics-dec...
Each generation saying that the next is having their attention span diminished by new media may seem "gross" to you, but that feeling hardly proves any of them wrong.
Pareto.AI | Multiple Roles | 100% REMOTE | https://pareto.ai

Pareto.AI is in the premium data labeling space, focused on ethical, high-quality labeling. We are currently working with some the largest names in the AI space and growing rapidly.

We have a few full-time roles available:

1. General full stack web development (Python, Django, React) contributing to building our core labeling platform. We follow a scrumban approach with an essentially flat organization structure. Everyone is given lots of ownership, everyone helps run our rituals, and you're able and encouraged to have inputs on everything we do.

2. A role suitable for 'hackers' who enjoy working with mixtures of technologies on constant short and medium term (few weeks to a few months) projects for more custom labeling projects. In the last few weeks this has involved things like overlaying text over screen recordings with ffmpeg, SQL + Python scripts to clean and prepare data for annotation, building a Django dashboard that collates information from multiple sources, and so on. Almost all greenfield, requires coordinating with clients to interpret the project requirements, estimating the complexity and eventually choosing the right tools for the job and executing on the work. A truly 'whiteboard to deployment' role where you get to have full ownership.

These are exclusively full time roles -- we can't accept part time or fixed term contracts. All roles require a strong command of Python fundamentals. We are a fully remote, remote-first company with the engineering team spread around the US, South America, Africa and Europe. There is essentially no restriction on where you're located as long as you're able to be present for our core collaboration hours of 8am PST to 1pm PST.

No recruiting agencies or similar, we're only interested in filling the open full-time roles.

Please mention me directly or HackerNews when applying to avoid getting caught up in the screening flow.

https://pareto.ai/careers

https://coda.io/@hellopareto/join-our-team

You can reach me directly at steven@[domain] if you have any questions that aren't covered by this post or the job listings, but any applications would need to go directly through the link above.
https://archive.is/XkBzL
Bun 1.1
NOAA – Next Generation Hurricane Modeling Hurricane Analysis and Forecast System
This may be approximately 25% of the theoretical maximum bandwidth (1.2 Pbps) [0]?

0. https://physics.stackexchange.com/questions/56240/maximum-th...
The real reason is always the same: it's cheaper. That's just the way it goes.
Only eat organic? You're paying too much, and it's not worth it, author says
Location: Tustin, California, USA
Remote: Yes, but willing to do on-site / hybrid in OC & LA area
Willing to relocate: No
Technologies: Python, Golang, Bash, Kubernetes, Docker, Elasticsearch, Prometheus, Helm, Git, Teamcity
Résumé/CV: Please request by email
Email: nguyen.matthewq+jobs@gmail.com

---

Hello, I am Matthew, a Platform Engineer with 2 years of experience. I am interested in SRE/Platform Engineer/DevOps & Backend Engineering roles.

Experienced in the following areas:
- maintaining systems in K8s
- monitoring & central logging
- setting up/debugging CI/CD pipelines
- packaging & artifact repositories

But always open to learn more and add more to my skillset. I'm actively seeking roles that offer career growth, mentoring, and interesting problems.
Frontend Developer

Location: Ibadan, Oyo, Nigeria
Remote: Yes
Willing to relocate: Yes
Technologies: React, JavaScript/TypeScript, Material-UI, Redux
Résumé/CV: https://drive.google.com/file/d/1xi9YAnHN6Fg4dsxZIFYmYeHfzr-Cfr92/view
Email: https://veilmail.io/zeenat
LinkedIn: http://www.linkedin.com/in/zeenatlawal

Hello, I'm a front-end software developer with 2+ years of experience creating user-friendly web interfaces. Looking for an opportunity to contribute to innovative projects while collaborating with a diverse team of talented individuals. Dedicated to leveraging technology to make a meaningful difference.
> The major sources of spam today are places like gmail and outlook servers.

By volume perhaps, but is that true as a proportion of all mail that was sent via these services? I'd be surprised, though I'd be very interested if there where any numbers publicly available.
There are so many uncomfortable questions I want to ask from this data, like which editors contributed to two different language articles which disagree about the same historical event.

Perhaps it is a good thing not have all data at our fingertips…
Meh, I can think of more important things I want the general population to know.

Let's start with basic statistics and data interpretation, media literacy, skepticism, theory of mind, case studies of genocides and rise of authoritarianism, civics, social and group psychology.
No...? The assertion about being able to understand the reverse case went out to anyone reading the comment. This is clearly a community forum, not some kind of private messaging system. Comments are not directed towards anyone in particular.

Stop and think. If you actually did somehow mistakenly believe it was a one-on-one with another person, why would you but your head into the conversation? That would be completely illogical. There is a curious contraction here.
I couldn't really understand this paragraph. Maybe I need a worked example?

> Bit rotation can be implemented using a combination of bit shifting and or operations, and on a hardware level, with different locical XOR ports. That’s of course just one way, and you still need a way to identify the number without confusing it with another figure. Although I don’t think that last was implemented: if you select your starting bits in a smart way, there won’t be any overlap. The identification system here uses 14 bits, and all of the figures have either 6 or 7 1s, making it even possible to completely ignore bit rotation and just rely on the relative position of the enabled bits to do the identification. I’m of course merely guessing at this point.

Not sure what it means to "completely ignore bit rotation" and "just rely on the relative position of the enabled bits", those sound like the same thing to me.

To throw my speculation out there, I wonder if this is just done with a lookup table. If we use a byte (generous) to identify each figure, then a table indexed by all 2^14 bit patterns will take less than 17kb. No need to do anything more clever.
I think there were some open PRs from that account, that got scrubbed from the account after the back door in xz was discovered. But probably nothing got merged.
From the title I thought it's a pg as a database vs file based databases aka no dedicated network interface comparison.

But then of course that wouldn't make much sense.

Holiday Monday derp.

Well it's good to see that the default ext4 is a very good choice.
I'm personally going for xfs on the server, because I'm using MongoDB as well.
Additional note: I run these on servers that are not very tall but are pretty wide: 40 1.8GHz cores or so. So multi-threaded decompression really helps. I was using xz before, which doesn't support threaded decompression (according tom man page), decided to switch to zstd rather than pixz.
> They can patch their own systems

"Their own systems" will necessarily include lots of civilian infrastructure. Hard to make sure all that gets patched without issuing a CVE, let alone without anyone in the general public even being aware of the patch.
> That is super interesting because I do not recall hearing about it or taking it seriously until early March 2020.

I had a co-worker with family in China at the time and remember asking her about whether they were okay. But I also planned a family vacation out of the country for March 2020, which shows I didn't fully understand the ramifications.
> DN$ only supports DNSSEC for customers in the ENTERPRISE tier

OK, so how much do I pay you to change that message to "DNSSEC is pointless and you should feel bad for making this request"?
‘Artificial sun’ sets record for time at 100 million degrees in fusion advance
It's Django (python) if you weren't sure of the name and wanted a look.

The table naming convention from the model name is a bit different, but impossible to know from just that code snippet. Also Django likes to explicitly list every field instead of *
Yeah this is basically what I was thinking of. The classic trip was Tokyo to Osaka, Kyoto and back and with the JR Pass that would have strongly incentivized you to go beyond Osaka to like Hiroshima and other places because at that point it was free.

Now it will cost more to go to Hiroshima+ and so less people will do that.
Magic Spell: AI prompting for <textarea>
Becareful with Stelara. The body reuses the same inflammatory cytokine group that is the target in the lungs to fight off infection. So, your lungs can’t fight infection very well on Stelara small issues can very quickly become life threatening.

I got Pneumonia that turned into Sepsis in about 60 hours. It happened so fast that the doctors brought in an addiction specialist. The only other time they’ve seen this is when drunks pass out and aspirate on their vomit. (Crohn’s doesn’t let me drink, so we can rule that out…) After days of studies, we found the warning label on Stelara about the elevated risk of lung infections. My care team reached out the Janssen and confirmed it. After about 4 days of IV antibiotics, I was sent home to continue on oral antibiotics.

Still, if I die from something like this, it’s still worth it to take these biologics. At least I lived a much better life for a while thanks them. The side effects can be life threatening, but the ability to have a life is worth it.

TLDR: On Stelara, I went from Pneumonia to Sepsis in about 60 hours while taking oral antibiotics. The warnings on the labels of the biologics are serious - and the side effects can be life threatening.
Great demo! Going to try this with a huge folder of call recordings that I would love to search across. Does it work with Google Docs as well as PDF?
In Microsoft land there's a sample reference architecture for .NET web apps: https://github.com/dotnet/eShop
Oh I didn’t realize they made Croc. That was a good game.
Friction – An Open Source 2D Animation Software
Built in rust? This needs to be at the top of my resolv.conf immediately!
> Is libc a problem for the ecosystem?

Absolutely yes. And also the size of the kernel.

Those two currently have a much better guaranteed quality than systemd, thus systemd is a much more pressing issue. But they don't stop being a problem just because they are not the largest one.
Just Launched my first AI SaaS, Help me with your feedback
I know you have seen enough AI Chatbots but hear me out. 95% of the Chatbots are simple text responses but we're changing that to make it more interactive. Voxal AI can recommend products, capture leads and more without leaving your chat.

You can select the objective for your Chatbot like Sales, Customer Support, lead generation and more.

Voxal AI stands out because it:

Free Plan: Generous Free Plan. No Credit Card required.

Engages Beyond Text: Imagine a chatbot that doesn't just respond with text but can recommend your products within the chat, turning conversations into conversions.

Optimized for Everyone: Whether you're a blogger, an e-commerce guru, or running a niche site for a small, passionate audience, Voxal AI adapts and optimizes itself, making your site the place to be.

No Code? No Problem: We designed Voxal AI so that anyone, regardless of their technical know-how, can set it up in minutes. Yes, minutes.

We’re especially proud of how Voxal AI enhances the shopping experience by understanding what the user is looking for and providing recommendations just like a knowledgeable store assistant would do – but online.

But why stop at e-commerce? We’ve seen it do wonders on educational platforms by guiding users to courses suited to their interests and expertise level. The potential is limitless.

We're inviting you to be part of this journey. Not just to try Voxal AI, but to shape its future. Your feedback, your insights, and your experiences will help us make Voxal AI not just a tool but a game-changer for online interactions.
As a former storage architect, I should point out that defaults are compromises and it is far more complicated as any benchmarking is.

Btrfs extent trees, XFS stride, stripe sizes. Partition alignment, WAL block and segment sizes all need to be tuned. Obviously abstractions like LVM and VM volumes impact this.

Short stroking spinning WAL drives. Or only partial allocation of SSD space was often required when systems were close to capacity.

But ZFS data consistency has a cost. And extents on spinning discs has a cost also.

8k WAL blocks with 16m segment defaults with 4k native disk sectors would be a place to start with 7200/60 = 100 as an assumption.
The N100 doesn't support 64GB memory I believe.
> because of this prevailing thought that the pencil was known as the lead pencil, a name that has endured until today

Wait, so we didn't realise graphite and lead were different substances until after pencils were invented? Yet we never took that mix-up to the point of putting lead in pencils?
Isn't a sign of a disease called ... a symptom ?
Looking for an idiot-proof AI article summarizer for 16 GB, Nvidia 6 GB vram PC
I'm super eager to get any and all feedback on how to make Otto as useful as possible, so please check it out! It's free to try!
I work on Bun and happy to answer any questions.

Note that Bun v1.1 is still compiling at the time of writing (probably for another 20 minutes)
The init system was utilized in a supply chain attack. Fixing the init system helps but is only a bandaid to the issue of supply chain attacks.
Depends on the color of your skin.
Read about Mother Jones: https://en.wikipedia.org/wiki/Mother_Jones
The description for mitosis is usually "a cell splits into two daughter cells" so we're right back to parents and children even with that analogy — which doesn't actually fit, because a process spawning a new process isn't usually duplicating itself.
When I really like a joke, I attempt to translate it into all the languages/cultures I know. Some are nearly impossible, but others, like "did you hear about the cannibal who was late for dinner?" are almost word-for-word.
I got 60 wpm in Javascript but I'm on top of the leaderboard on #458 (also the only person) >:)

This is really polished for someone in high school, good job!!
They do. All the time. It seems to only be news when they support Trump or are against the Democratic presidential candidate, though.

https://www.defenseone.com/ideas/2024/01/foreign-interferenc...

https://apps.dtic.mil/sti/trecms/pdf/AD1213704.pdf looks to be an excellent review of the subject, though I've only now discovered it and therefore haven't read it in detail yet.

E.g. "Russia has been trying to influence elections worldwide since the 17th century
(Shimer, 2020). Election interference is also a goal of many Russian military operations.
Many of these disinformation campaigns aim to sow discord among the population and
attempt to get elected the candidate that best suits Russia’s interests."

It seems quite clear to me that every nation participates in misinformation campaigns to affect other nations' elections in was beneficial to the actor.
For anyone curious llamaindex's "prompt mixins", they're actually dead simple: https://github.com/run-llama/llama_index/blob/8a8324008764a7... - and maybe no longer supported.

I basically reinvented this wheel in ragdoll but made it more dynamic: https://github.com/bennyschmidt/ragdoll/blob/master/src/util...
yep - Google Doc and MS Word files exported from Drive API as text and PDF files' text extracted with PDF.js
Even if that were the case (big "if"), that can't go on forever. Even if it's literally just a matter of who has enough data and training core-years, at some point a competitor, maybe with state-level support, will have "enough" data to come after you with their own self driving option. Perhaps now Tesla is at 90% (just say, it's just an example) and Mercedes (again say) is at 10%. One day Tesla may be 100% and Mercedes is at 30%, and the German government, for one, will be shoveling cash into the furnace the whole time if the German auto industry is in existential danger. The gap can only close.

Meanwhile once you reach full self driving, you're stuck at diminishing returns. Doubling your data won't double that: at best you could make a very marginal improvement to safety stats or range economy. Maybe with a lot of lobbying you could swing a slightly higher Tesla-only speed limit, but double self driving isn't a thing. Everything else in the car is commodity stuff like sound systems and seat heaters that anyone with a car factory and a team of designers and a copy of the Bosch Automotive Handbook can do if they want to. Probably you could get some network effects from the "Rent your Tesla out" app, but again, that's an option for anyone with a team of designers once the self-driving part is done and they'll be in the disruption phase and aggressively undercutting as best they can.

This also assumes that in 2029 you can't just use 80% (again... just a random date and a random number) synthetic training data and leapfrog nearly all of those hard-won physical miles. The costs of doing that will plummet too, so the training cost moat will only shrink as well.

Meanwhile Tesla will be ossifying as gigantic trillion dollar behemoths tend to do, accruing costs like pensions, management entrenchment will be in its third decade and so on.

On the other hand, if we're doing hypotheticals, if it did come to pass and Tesla is sitting pretty on a 13-figure valuation predicated on it being the only self driving car out there and a competitor pops up suddenly from stealth mode with a fully-formed alternative, much of the value could evaporate so fast it would be a structural hazard to the economy. That would be an interesting situation. And, remember, are that point it's all predicated on the software being the key, so Upstart Autonomy Inc. can license it to Mercedes and get it in cars almost immediately.

Is Tesla worth a lot? Undoubtedly. Is it that much? Questionable to me. But then the market disagrees, so what do I know (but also the market was off by 30% by it's own estimation so how much does it know?)
Check out The Science of Programming Matrix Computations by Robert A. van de Geijn and Enrique S. Quintana-Ort. Chapter 5 walks through how to write an optimized GEMM. It involves clever use of block multiplication, choosing block sizes for optimal cache behavior for specific chips. Modern compilers just aren't able to do such things now. I've spent a little time debugging things in scipy.linalg by swapping out OpenBLAS with reference BLAS and have found the slowdown from using reference BLAS is typically at least an order of magnitude.

[0] https://www.cs.utexas.edu/users/rvdg/tmp/TSoPMC.pdf
This is NOT to halt chrohn's disease. This is to reduce side effects from primitive colon-removal surgery to treat Crohn'# symptoms.
Super impressed how quickly the community and in particular amlweems were able to implement and document a POC. If the cryptographic or payload loading functionality has no further vulnerabilities, this would have been also at least not introducing a security flaw to all the other attackers until the key is broken or something.

Edit: I think what's next for anyone is to figure out a way to probe for vulnerable deployments (which seems non-trivial) and also perhaps possibly ?upstreaming? a way to monitor if someone actively probes ssh servers with the hardcoded key.

Kudos!