skysight-inc/HackerNews huggingface dataset:
Ask HN: How do I get into deep tech?
I’m a software PM with a medical degree who’s worked mostly in digital health, and am eager to transition into deep tech. I’m particularly interested in neurotechnology, BCI/AI hardware, med devices, but am certainly intrigued by other areas.

What would be some routes to break in at this point in my career? Is pursuing a masters worth it? Do I join a deep tech co on the software side and try to transition?

Any advice would be appreciated.
We have a library with about 100 algorithms which you can choose from or by default we automatically choose based on your objective.

Majority of them are open source models we've forked and improved. Just as an example, we integrated in gSASRec last week: https://github.com/asash/gSASRec-pytorch, and added a couple of improvements on scale and the ability use language and image features. We use LLMs for the encoding of unstructured data, and we host these our self, although OpenAI and Gemini are used for error message parsing and intelligent type inference, things not on the real-time path.

More info here: https://docs.shaped.ai/docs/overview/model-library
The point is that it was GitHub that caught up for some simpler use-cases fairly recently, not the other way around. When I started using GitLab 6 years ago it made GitHub look like a toy where you had to reach for external services like Travis to do anything useful.
Yeah I’m pretty sure being 80 sucks regardless. Though being 50 doesn’t have to suck and if you live the wrong way I think it often does.
(ftr - I am using the definition of "classic", as I make suggestions/recommendations, applying to works produced more than a century ago)
Institutes of the Christian Religion by John Calvin

Regardless of whether you are Protestant or not (or religious or not) - understanding the theological philosophy of one of the great thinkers of the Protestant Reformation is a wonderful addition to your own mental maps fo the world at large
I find AI to be as bad as search engines, except they will try to pass the wrong answer off as the correct one
We have a team of domain expert who do the vetting of the instruction dataset.We do typical RLHF(Reinforcement learning from human feedback) and connect back to our SFT(supervised finetuning) loop.That's why we name ourself as hardware and human in loop.Humans play an important role in ensuring quality and accuracy of our dataset.
The profits aren't just going to pay themselves to shareholders - consumers have to do their part!
Like the idea, I once did marketing for a startup and creating infographics was as useful as it was laborious....

Feedback: The fact that two of the examples on the page use the exact same format (the paperclip) and all of them also follow the "top to bottom" reading pattern (no landscape mode) gives the impression that it's just a handful of templates and rules not really AI. Not sure if that's correct but that's the first impression it made on me.
Sam McDavid, Machine Learning for Stock Trading in Elixir [video]
i have no idea what you intended to say here
SoCs are inevitable. The CPU is a black hole which will eventually absorb all parts of the computer. As SoCs become more capable, discrete components will inevitably find themselves less commonly used outside of datacenter and workstation. This is a natural outcome of increasingly dense transistors and was observed by the CEO of Centaur Technologies in the 90s.

One of the neat aspects of multi-chip modules and specifically AMD's implementation of chiplets, is that they are able to share chiplets across segments, improving yields, volume, binning, and profitability all at the same time. Their 3D VCache has also been very exciting, as we're starting to see Epyc CPUs with L3 cache measured in gigabytes.

I think Apple made very smart decisions about jumping to on-package DRAM in terms of taking advantage of the increased bandwidth to bolster performance, and in the ways it worked with their pricing model. Though I think it's clear that 8gb system memory is about the minimum anyone could get away with shipping in such a system. As things get denser, numbers will only go up, and the pain of being stuck with a fully integrated system should decrease. 10 years from now, a SoC with 256gb DRAM integrated will feel very different from a bottom tier M1, while likely occupying a similar price point.
$5/mo is exactly what https://www.adblockpodcast.com/ costs.
"Confessions of an English Eater" by Thomas De Quincey. An autobiographical work in which the author details his unfortunate descent into Laudanum addiction. It all started well, but ended badly...
I've dreamed about making my own language for about 10 years or so. Started out just messing around. My vision for what it would be and its purpose has changed over time. About 2 years ago, I "got serious" about designing and implementing it, though that doesn't mean I've spent a serious amount of time on it yet. But it's happening!

It's a language for the domain of writing and verifying formal proofs. Basically, I didn't enjoy the experience of working with the couple of proof assistants I tried, so I'm doing my own thing. My objective is to create a language where I can document "everything I know" about math, if for no other reason than to prove to myself that I know those things, and to return to that knowledge if it ever slips away.

It's so much fun!
This article is very forgiving towards tech companies, suggesting that users are techno phobic and the solution is to remove such labels.

My perspective: consumers have seen new tech emerge a thousand times and are favoring reliability instead of the flavor of the month new tech, especially when it was designed to sell instead, not to solve real problems.

This seems just like TVs, where more people long for dumber TVs with quality display - they are faster and more reliable than what the market of smart TVs is providing.
Congratulations on launching!

Trellis looks amazing... but only if it works well enough, i.e., if the rate of edge cases that trip up the service consistently remains close to 0%.

Every organization in the world needs and wants this, like, right now.

If you make it work well enough, you'll have customers knocking on your door around the clock.

I'm going to take a look. Like others here, I'm rooting for you guys to succeed.
That's exactly right. Land is not a commodity, in fact it is the absolute furthest thing from a commodity. Plots of land are different, and command different valuations based on location. It is not produced by anyone and has an unchanging supply. To call it a commodity is so completely backwards.

There are supply and demand dynamics in the land market. However much excess value you get from occupying a certain location on Earth, is how much people will be willing to pay for that. The demand will always be high as long as the value from the location is higher than the cost to occupy. This cost will soak up any advancements in society, which is why despite everything we have done to progress the state of man there is still a class of renters giving everything extra they make due to societal advancements to landowners.
> That is a straw man.

No, you very specifically claimed "Their actual mathematical conclusions are what matters" and derided the non-mathematical conclusions in your own link as "platitudes". What are those mathematical conclusions with regards to regulation of naturally arising cartel-like behavior?
Fafsa rollout was 'a failure,' college aid expert says
The Travels of Marco Polo (I prefer the Modern Library edition translated by Manuel Komroff (it was published in 1931, but the source dates to the 13th-14th centuries))
> Whenever a scientist says that it's not possible that the model is wrong, then I just roll my eyes.

But no one said that. Im fact, scientists are known to say things like: all models are wrong, but some are useful.
There's just no way this wasn't going to be a lagging effect after the extreme spending in 2020 due to Covid.
I made a little toy compiler for a university project many years back, and I agree with the article - it's quite a nice way to get hands on with syntax and helps you think a bit more deeply about what is actually happening.

https://github.com/Podginator/Rattle/tree/master

It used JavaCC, which I found to be a pretty simple way to get up and running.

I also worked a job that used yacc to create their own DSL for a piece of software. Same thing, really. Easy enough to get up and running, and messing around with.
Stennis isn’t going to keep welders around. Those are the design and engineering support personnel.
Hard agree, and you’d think white and black would work best, but then there’s the legacy black levels / white levels thing alluded to at the end of OP’s article...
The issue isn't the need, it's the willingness/capacity to do so that's a problem.
CTO here, using BAML in our stack has let us use LLMs a LOT more in places that wouldn't make sense without the type-safety. We started using it for line item tag prediction and classification, false-positive checking on our fuzzy match algo, and forecasting. Especially with models like 4o-mini and Gemini Flash, its now actually cost effective to do this at scale.
There has been some work to dynamically reduce the compute required by a network.

See for example: https://arxiv.org/abs/2404.02258

They have a fixed compute budget which is lower than what the LLM need, and dynamically decide to allocate this compute budget to different part of the network.

So its not exactly what you propose since here the compute budget is fixed (that's the point of the paper: to make the network learn how to allocate the resources by itself) but its dynamic for each part of the network, so it shows that its possible.
Epyc is also vastly ahead of Xeon in terms of number of PCIe lanes provided, which can be critical in many applications.
Umm if we are looking for analogies. I would prefer a castle built on rock rather than one built on sand.
I did name the features directly.
They'd need some very big RTGs to last that long, and I don't think we manufacture plutonium at the necessary volumes for that anymore.
yeah man, I remember reading stuff like that before I was sold on it and eventually it got to me (probably after another borked Arch install) and I was like "fuck it, I am diving into this mess come hell or high water" and...

... Yep. It's exactly as s/he said it. Once you grok it, you literally want it on EVERY COMPUTER YOU OWN.

IMHO it still needs to get more user-friendly, or at least have another layer that is more user-friendly, as well as have ramp-up materials that are consolidated and good, before it will be more widely adopted
I'm not aware of any npm monorepo support but I was just using some packages from npm and thought I can also use its 'script' feature to up-keep the repo.

And to attach to a container, you should be able to just run 'Attach to running container' from command palette after you bring it up
Yes, pop in a normalizing flow that removes tone and recreates it with a small audio sample as context.

https://arxiv.org/abs/2312.01479
Seems like a better comparison would be any schemaless binary format, like msgpack, bson, or the many others. This adds some basic type validation, which you would have to do with a separate library, like msgspec if you're using Python.
Yes, my apps are buggy, inconsistent, and incomplete (as are all apps). But they're less bad than my language would be, because they're my day job, and my language wouldn't be.

So, not checkmate at all.
DUNE scientists observe first neutrinos with prototype detector at Fermilab
I think the problem with such a mission right now is the high probability we could launch a faster mission in the very near future - i.e. with NASA looking at spaceborne nuclear propulsion again, we could send much more capable telescopes out faster - which is not just an "I want it now" benefit: time in space is time you run potentially having components wear out or break. So getting them onto their missions ASAP is a huge de-risking element.
The short answer is: we're better at recommendations and personalization and lean towards more technical teams (e.g. even with data/ML experience). They're better at traditional search and, these days, lean towards less technical teams.

Longer answer is in our blog post about it: https://www.shaped.ai/blog/shaped-vs-algolia-recommend :)
Would you happen to know of a documented workflow? Or blog posts that present solutions like this.

I would be very interested in how seeing how other people are doing it.

Thanks!
Not directly, but making bootable images is much easier if your firmware is stateless and does not require setup with efibootmgr.
Do you have one in safe Rust?
See, we've only just met, and I don't know how you handle your ptr/len arguments in C just yet. ;)
There was no video
Maintaining the right level of accuracy across different domain is quite hard and something we spend a lot of time on. The accuracy bar tends to be quite high for financial services so we're adding some validation steps and checking to make sure any errors get caught beforehand.
Is "luxury beliefs" a useful category?
Please visit https://h2loop.ai/ to know more about h2loop.ai
This is an exciting development for system software engineers working with complex code in languages like C, C++, Go, and Rust. The integration of expert review and validation adds a layer of reliability that’s often missing in generic coding assistants. I’m particularly interested in seeing how the RAG-based parsing and collaborative fine-tuning work in practice. Looking forward to experimenting with the demo and seeing how this evolves. Great work, Team H2LooP!
Yes, new and scary. But I remember the evening news planting the idea that it was (more) dangerous to the public. Took years for that to dissipate.
Amiga OS didn't have virtual memory either.
It is always my dream to write an interpreter for my imaginary language that does provide a more human readable syntax to write scripts. It is basically language that compiles to bash because it is everywhere but I really hate writing bash although I write bash/zsh code a lot.

Yes I can use python (other scripting language for that) but this is not cool as writing your own programming language and also you don't always have access to python environment. Bash just runs everywhere (at least for me). It is also my motivation to learn about compilers and how they work.
Bloodletting, leeches, and other FDA-approved treatments
Please visit https://h2loop.ai/ to know more about H2LooP
Can this be used for audio fingerprinting?
It's a theoretically great political wedge issue. It's available to some people and not others, something some people want and others don't, negatively impacts some people and positively impacts others, and at the end of the day, it doesn't really matter.
Nobodys claiming no group of people lived in Denmark, Hungary, China, etc for 999+ years.

They're claiming none of their governements is over 999 years old.

Denmark's constitution is from 1849 [1].

Hungary's constitution is from 1949 / 1989 [2].

China's government is form 1949 (when the previous government got overthrown and went to Taiwan) [3].

I'm not going through the whole list.

[1]: https://en.wikipedia.org/wiki/Denmark#Government_and_politic...

[2]: https://en.wikipedia.org/wiki/Politics_of_Hungary

[3]: https://en.wikipedia.org/wiki/Government_of_China
Yeah, thats the issue, tab completion can only do so much.
"Just" ensure your responsive design snaps to checkpoints where this registration matters, and prepare video assets accordingly.

One way to ensure this is layout using, ahem, tables. (Don't laugh, it works for the site you're reading right now...)

Not everything we've come up with in the last 20 years made life easier...
the underlying issue, is that tab completion can only do so much.
I remember reading that the local group, Laniakea Supercluster and the great attractor [1] are new developments that helped us refine our understanding of H0 but didn't fundamentally remove the controversy.

It's exciting to see how the question drives many new discoveries.

[1] https://en.wikipedia.org/wiki/Great_Attractor

I'll try to paraphrase what it meant: measuring H0 comes down to measuring the relative velocity of galaxies around us. The great attractor was a relatively recent discovery that the "closer" galaxies, the ones we can use in the distance ladder, all have a common component in their velocities which we've recently begun to understand better.
Musk ordered to pay X employee £470k for unfair dismissal
It's mentioned in the article, great to hear Paul tell it though!
Go 1.23 Release Notes
How does this compare to Vespa? If the key difficulty in scaling search is infra as you say, Vespa is an interesting alternative.
Anyone know of other blogs similar to Sam Curry's web API exploitation stuff?
I've met so many people who've had issues with Lasik at this point that I've decided I'm not going to risk it unless absolutely necessary.
See also the Configuration Complexity Clock: https://mikehadlow.blogspot.com/2012/05/configuration-comple... .

This is why I have a separate config language and code language.

My config language is essentially JSON with newline separators and a first-class binary type (base64). I added little else.

When I get the temptation to add code to it, I just pull out my other, general-purpose language instead.
Nil is built-in. You just have to write the code to instantiate it and the compiler gives you one. The coder does not need to create an implementation, it's there for free.

I would not have called it a "second implementation" myself, but that's your claim to defend, not mine.
Can't read the article, it's on a website that doesn't have good enough support for all browsers or settings.

But I do remember the way bananas were sprayed using a very light petroleum lubricant (not considered a "distillate") that was supposed to be able to make fruit flies "stick" to the plants, trapping them without there being any of the highly toxic insecticides used on so many other crops. I guess I would never know if they actually did add some insecticides to the banana spray oil before applying it though, on occasion.

I can confidently say you should probably not put bananas in the washing machine ;)
Exact accuracy depends on the domain and tasks. Processing emails will naturally have higher accuracy than 150+ pages of private credit documents. Generally, we see 95%+ accuracy out of the box and can go up to 99%+ with fine-tuning, and human in the loop validation.
Historically in autoconf codebases (which PostgreSQL is) `make dist` is done: a) after `./configure` (so you have a Makefile, naturally), which is b) after `autoreconf -fi` (so you have a `./configure`). This allows the dist archive to contain the outputs of `autoreconf -fi` so that users need not have autoconf installed and they can just run `./configure`.

Switching to `git archive` is fine, and you can add files to that, but https://github.com/postgres/postgres/blob/master/GNUmakefile... doesn't. So, I guess users now _have to_ run `autoreconf -fi`? No, because those are now committed in the source tree (https://github.com/postgres/postgres/blob/master/configure).
Got it, and how well does it work with more complex documents, like those with a lot of images or intricate tables? I'm curious about how accurately it aligns the content with the source code in those cases.
Yes indeed, regulatory capture is a problem.
Though it is worth noting if this were the case you would expect to see boundaries: if the laws of physics change due to spatial position, the discontinuity should produce an effect of some sort where matter and light transitions between regions.
> and life is pain

So glad you finished with this. Right now I’m working with a guy who wants to write an interpreter…
I think the point is that

- you write some piece of software

- then you add a straightforward configuration language

- then you add variables because you don't want too much copy/paste

- then you add if statements to allow conditional configuration

- then you add loops because you are sick of seeing configuration that consists of unrolled loops

- ...

At some point your configuration system is Turing complete, so could be considered a programming language. However it was never designed as such, so it is not a horrible one

TeX would be a good example of this. Ansible playbooks are (I believe) Turing complete, and YAML itself has such a huge spec, that if it isn't Turning complete and/or self aware already, I can't imagine it'll be long before it is
Thanks shrianshag..You can try some sample Datasheets(pdf) and ask code generation questions.
At some point there will only be the galaxies in our local group visible, it's interesting to imagine a future civilization only having such a limited universe to view.
Just because we are natives of this universe does not mean its behavior or characteristics will be naturally sensible to us. There is no “real” reason it should be something “simple” or reasonable to us. The universe simply is; us as well.
LASIK hadn't even made it to the conceptual stage then. Early trials for vision correction via radial keratotomy were ongoing at the time of his death.
Great idea. I used to work at Instabase, which you probably compete with. The better you are at dealing with dodgy PDFs and document scans, the more valuable this will be to big banks, shipping companies, etc.
No, the reverse.
Exactly. Now we have a new UI paradigm and a new, incredibly powerful NLP tool in our toolkit.

Is this AGI? Of course not. Is this useful and valuable? Obviously.
This is where the "ungodly" funds of Cold War make the difference. There is little incentive in the US government to spend at once as much and take political risk as much as it did back then.
I don't think I understand why not ... Presumably there has been a lot of immigration to the Netherlands in the same time. Naturally building needs to keep pace with immigration, so (300k + net migration) homes sounds like it should resolve the problem. If not, why not?
Ah so it's more like Steam than like just subscription management. Thanks.
The article doesn't claim that you should make a language and actually use it - the author focuses on the learning experience. He makes valid points.

No, it's probably not the right learning experience for everyone (clearly, it won't be yours), but there's definitely value in it for some people. And if reading the article nudges a few more people to take that learning dive, I think that's a good thing.
The mere mention of the word "testicle" makes you think that your coworkers want to have sex with you? Wow.
I am coming from the search world, but databases were my first experience in the industry.

It would be interesting to see some things like Learn To Rank or semantic reranking become a part of SQL. These have real impacts on accuracy with generative AI.

Not sure how practical this is.
I have more macro questions about this. Sometimes I find engineers aren’t best placed to evaluate cost at all. What might be perceived as expensive (say relative to a salary) is not expensive at all in the context of the business problem being solved.

Think there’s a book called “measure what matters” and the idea is what we measure shapes companies and behaviour. So I’d be very careful about implementing anything like this in my org.
The best way to deal with greedy members of any particular profession is ironically to flood the market with more people in that profession
How I became the Taliban's portrait artist
I responded to a sibling comment with an explanation: https://news.ycombinator.com/item?id=41234913 But good on you for the condescension even though you didn't understand my point ;)
We use multimodal RAG and tools similar to unstructued.io ,We generate structured output and use LLM again to do the matching with our AST parsed source code.Now matching part is really complex and need manual inspection and validation.