skysight-inc/HackerNews huggingface dataset:
As a developer I always found these maths-first approaches to Kalman filters impenetrable (I guess that betrays my lack of knowledge, I dare cast no aspersions on the quality of these explanations!). However, if like me, it helps with the learning curve to implement it first, here's a 1-dimensional version simplified from my blog:

function transpose(a) { return a } // 1x1 matrix eg a single value.
function invert(a) { return 1/a }

const qExternalNoiseVariance = 0.1
const rMeasurementNoiseVariance = 0.1
const fStateTransition = 1

let pStateError = 1
let xCurrentState = rawDataArray[0]
for (const zMeasurement in rawDataArray) {
const xPredicted = fStateTransition * xCurrentState
const pPredicted = fStateTransition * pStateError * transpose(fStateTransition) + qExternalNoiseVariance
const kKalmanGain = pPredicted * invert(pPredicted + rMeasurementNoiseVariance)

pStateError = pPredicted - kKalmanGain * pPredicted
xCurrentState = xPredicted + kKalmanGain * (zMeasurement - xPredicted) // Output!
}

https://www.splinter.com.au/2023/12/14/the-kalman-filter-for...
A lot of job requirements that I see ask for Masters or PhD, so you’re hitting the minimum requirement plus giving yourself a shot of having applicable work experience (read: doesn’t write spaghetti code). That said, there’s probably a huge selection bias due to my background.
back in the 90s this woulda been referred to as cracking.
As I said elsewhere I applaud the idea, a couple of comments.

1. On Firefox on Ubuntu the text is _far_ too faint, to the extent the initial text is essentially unreadable.

2. I was getting brown coloured areas surrounded by a slightly different brown colour. The outlined area could have been a roof or just some slight change in l and colour. I understand this is why help is needed to classify them but it felt wrong clicking either "Correct" or "Incorrect" ... maybe with enough input it doesn't matter ? Not sure.
Why is this implemented in python? Is it compiled some how?
> We don’t have surnames, but instead two given names. ... So I have my dad’s last name ....

Did your dad choose your last name? (Which, I've read, has a specific meaning in Hebrew, but I'm guessing your family isn't Jewish.)
People who don't want to read the first line of the article, rejoice!

It sounds like a good decision though. Formal verification tends to make more sense in highly concurrent situations where there is a high-value stable API to be supported. That describes graphics cards and surrounding environments really well so it makes sense that Nvidia would find use cases.

Something more from the article is also that they made the decision with a pilot project that went well. It'd be nice to have more details about it; that sort of thing is important to do well and always interesting. Lo and behold, we do have more details about it! https://blog.adacore.com/when-formal-verification-with-spark... - there is a video in there that looks to be worth a watch.
Android Police has really gone downhill since they were bought out by a larger media company. Basically blogspam at this point.
It's expensive, accuracy isn't very high, and no one has done the studies to demonstrate that it actually improves subject outcomes. By its very nature that type of research takes a long time because the investigators have to wait years to detect a difference in subject survival rates or other significant endpoints.

There's a huge amount of funding going into the liquid biopsy space so things will improve. But don't expect rapid changes in clinical practice.
Thank you! Really happy to know that it's working well for you -- we made the additional searches feature exactly for this type of use case.
This gives me a childhood flashback to a show called MathNet, an educational police procedural (a la Dragnet) where both investigators have holstered calculators.

https://en.m.wikipedia.org/wiki/Mathnet
Show HN: Dockershrink – AI Assistant to reduce the size of Docker images
For the past few months, I've been hacking around a project I call Dockershrink.

It automates a simple task: Take a Dockerfile and optimize its code with the goal of reducing the size of the final Docker image.

People don't realize that we can apply some very basic techniques to reduce, for eg, a 2GB image down to just ~100MB:

- Multistage builds with light-weight base image for final stage

- Remove unused dependencies

- Optimizations specific to the tech stack

And I feel like I've already done this optimization for my personal projects and backend apps at my job(s) a couple of times.

The project currently uses GPT-4o (open source so you can run it locally) and only works for Nodejs projects.

There are a couple of reasons why I think dockershrink can be better than using just Vanilla LLM or Github Copilot/Cursor:

- Image optimization can benefit from a lot of custom prompting, especially when you have insights about specific tech stacks. Describing techniques deeply in the prompt gave better results than simply asking the LLM to "optimize code for bloat reduction".

- A RAG approach will be truly beneficial. I plan on giving dockershrink access to up-to-date documentations of Docker, Bash and all programming languages out there. Additionally, it can be given a few suitable chunks of code to enhance the context.

- Analysing custom base images: most orgs have their customized base images. Adding context about these can further help Dockershrink make better decisions.

Try it out - "brew install dockershrink"

Happy to hear your thoughts!
Show HN: Modelteam – Code to Skill Profile
reminds me of https://mystery.knightlab.com/
For me, it was the same but with the game boy. Turns out no-one knew the name of it. For some reason.
> the experts that developed the libraries over a weekend is frankly fantastical.

this is not synonymous with "most [C++ programmers] in industry"

The claim was the person learned it better than most people in industry, not most people writing the libraries upon which the industry is based

EDIT: Also we don't technically know when this happened. If this story is from the 1990s, it's a lot more likely, because think of how many shitty C++ programmers there were back then since we didn't have all the language options we do now. It was still the language taught in schools, for example. Then it was Java and Python and JS etc. But back then, Jonny Mackintosh was writing bad C++ out of uni.
Was Hellwig first, or Andre Hedrick, or maybe Hans Reiser?
Corporations can also kill you, enslave you, steal your property, start wars, and take over your country. Think of something like Pinkerton, United Fruit, Wagner, or the East India Company.

Governments, corporations, and criminal organizations are not disjoint categories. There is a lot of overlap near the boundaries. You should focus more on what the organization is actually doing than on its nominal classification.
My only conclusion is that Monzo would rather embrace the apocalypse than rely on Microsoft Azure to provide a tertiary fallback.
Powersort is pretty neat, here's a blog post with links to talks about it by one of the authors:

https://www.wild-inter.net/posts/powersort-in-python-3.11
There's an anti-footgun heuristic that asks "are you sure", basically, if the file about to be tracked is >=1mb, saved a lot of asses a lot of times.

But also, if it is such a showstopper, you can disable auto-amend of _new_ files with snapshot.auto-track=none() config (or even something funky like src/*) - and recently jj status finally started showing untracked files too, it's very usable
President Musk specifically said he wants to focus on getting more H1-B visa holders in the US

https://www.cbsnews.com/amp/news/musk-vivek-ramaswamy-h1b-vi...
I know you were trying to be smart here, but this isn't about debating the outcome of the election, that transition was already handled in a peaceful manner.
> After ComEd receives confirmation that the project has passed municipal inspection, it can take anywhere from 6 to 18 weeks to complete the permanent residential electric service and up to 6 months for a permanent industrial electric service, depending on the amount of work required.

6 month turnaround sounds pretty weak.

https://secure.comed.com/MyAccount/MyService/Pages/RequestIn...
Those muscles got their energy from government stimulus.
I mean I figured that was a given.. Obviously help the people in your life (and not in your life to the extent possible).. But you should already be doing it anyway wealth or not. I just meant that if I didn't have to work for money anymore it would free up time to do a bunch of things that are otherwise just.. dreams for if I'm able to retire someday. I simply can't imagine the mindset of someone who wouldn't take that at the earliest possible opportunity. Also, it turns out if you have a shop and a ton of free time you can use that to help people ;)
Unlimited is only $10, more than worth it for me.
Taking a quick look around on their website it seems you can have them host for you or self-host but absolutely requires k8s. If I'm wrong, point me to the doc that shows you how to self-host without k8s and I'll officially be excited.
20 people would have an impossible time trying to fix the existing web because they would be up against FA*NG companies etc.

But if 20 people design an alternate system (protocol, browser, security features, etc) from scratch, and their incentives are right, yes they could come up with decent protections against users with bad incentives and against bots.
Hopefully what's dying is the concept of privately owned utilities. Everyone knows that, unless they're properly regulated, these eventually turn into a rent-seeking behemoths that corrupt the government (or vice-versa).

However, what will likely happen is that these private utilities will see the writing on the wall and instead do what PG&E is doing in CA and just start charging "transmission fees" to keep their rates even higher despite massive daytime solar abundance.

Everywhere there is state/municipal owned utilities it's almost always considerable cheaper than private.
Depends on how you use it. For non-developers, under 10 searches per day on average sounds right. Not everyone has a job where they sit on a computer all day.

For me, I use Kagi only at home for personal use. And most months, I don't exceed 300. Of course, if I included work related searches, then yes - 10 searches won't get me far.
The SNES probably has tools like this, and a GBA is pretty similar limitation-wise to a SNES.
I'd arguing that HN should take a stand against the unprecedented shift towards authoritarianism. At best be are in a new era of McCarthyism. At worst the entire federal government is going to crumble and be dissolved.

This is not hyperbole!

Trump and Elon have started the first round of firing federal workers. A friend's organization just laid off 1500 people because 80% of their funding comes from the federal government.

Yes, HN is a special place. But your silence allows countless other special places to be destroyed. By the end of Trump's term HN might not even survive anyway.
Python is a terrible choice for that sort of thing. Who really wants to have to set up a venv and deal with pip nonsense just to write a config file? Hell even installing Python is sometimes difficult.
An honorable mention. This was in fact my inspiration for creating SQL Noir.
Man, I have lost my voice on this issue. Disagree and commit they say.

I'll tell you, managing two systems in different languages that need to interoperate, it's tough. I'm so sad C/C++ couldn't get organized and iterate towards something better. There is a huge trade-off being made here - all the effort spent writing some things in Rust, well it's also not going to fixing all the C++ code. That's still there. Sometimes the forest gotta burn for new flowers to bloom. I hope it burns fast.
My impression is that there are prized PhD jobs that people go back to school in anticipation of and there are essentially non-PhD jobs that are filled by people who don't go back or H1B workers who have a PhD.
Yes, but my government wouldn't care if I organized a protest. It's even likely that if I did, the police wouldn't even show up, and in the end, I have democratic control over it.

Meanwhile, I am in literal competition with basically all other people's companies.
Watch out what you wish for though. With age our hearing degrades and the experienced frequency shifts. There's a number of people with perfect pitch recognition who mentioned getting annoyed when they got older and everything sounded slightly off. For practical music, relative pitch is fine and commonly trained.
Perhaps we could:

https://en.m.wikipedia.org/wiki/Homomorphic_encryption

Someone far smarter than me could probably tell us if this actually works in the real world?
By "it" I meant this part from TFA:

> you should write a native extension with a very very limited API where most work is done in Ruby. Any native code would be a very thin wrapper around the function we actually want to call that just converts Ruby types in to the types required by the native function.

I think our main disagreement is your assertion that any compilation at runtime qualifiees as JIT. I consider JIT to be dynamic compilation (and possibly recompilation) of a running program, not merely anything that generates machine code at runtime.
I guess after ~30 years past grad school in the software industry, having had high hopes for the internet and everything back in the 90s, I'm way too cynical.

This won't be used to "close the care gap", unless they can charge more $$ for the additional checkups than they'll expect to have to give out in care as a result.

And they'll drop anyone suspected of needing too much care in the future based on their genome, even if they aren't sick. Pre-existing conditions times 100 (you know they'll be re-instated by the current administration soon enough).

e.g. 17% of the people with that gene had cancer, and you have it, so raise your rates 151%. Oh wait, 37% of the people with this other gene had dementia - you're no longer covered.

Eventually, they'll only accept those people with a genomic lifetime 90% profit profile. That's the way this sort of thing works in the "real" world.
> The thing about Charleston's fence is you don't know why the fence was erected. But we do. The government created it, and the government can remove it.

Knowing Bob put up the fence is not the same as knowing WHY Bob put up the fence. You've answered the who, not the why.
Thanks, it's generated with Hugo using the https://github.com/adityatelange/hugo-PaperMod theme.

However, I made some modifications to the theme for the first time recently, and learned that I absolutely hate Hugo's templating language. I might switch away at some point in the future (perhaps to https://github.com/getzola/zola -- the templating is Jinja2-esque).
> "lots of self-generated power will ultimately be wasted."

This is sunlight falling on a roof. If you convert it into electricity but then don't use that electricity, is it really a waste? It's like saying that the overflow from my water tank that collects rain water off the roof is 'wasting' water.

It could be argued that it's a waste in the sense that the generated electricity could have gone to someone else if there was a grid, but if the grid operator isn't allowing excess to be put back into the grid (e.g. because there's no demand at that time because it's sunny and everyone is using solar), then the grid operator needs to solve that with some form of energy storage (e.g. batteries).
With what you described it sounds like jj is _literally_ exactly what you need, lol

Give it a try, but also know that git branches and _topological_ branches are different things
You mean killer drones

https://www.vegard.net/google-helps-pentagon-train-killer-dr...
Norway and Singapore are petro-states. Alaska and Texas (to a much smaller degree) have wealth funds off of resources. Whether they're fiscally responsible with that is up to the state.
I succeeded in understanding the Kalman filter only when I found a text that took a similar approach. It was this invaluable article, which presents the Kalman filter from a Bayesian perspective:

Meinhold, Richard J., and Nozer D. Singpurwalla. 1983. "Understanding the Kalman Filter." American Statistician 37 (May): 123–27.
Any good resources on Vulnerability Management?
My company has tasked me with building a vulnerability management program. I'm a security engineer but have little experience on best practices in this space. Does anyone have good resources to share here?
Well, I've had an account for over a year. I think that the voting system is not generally very good, as it is subject to the same ills as all other such systems. Productive comments with unpopular views inevitably get buried, especially on threads which touch anything to do with politics.
Oh yeah! Hadn’t thought of this. OCR the kindle screen while flipping pages?
One of the extra problems in the UK is that PhDs in STEM were massively centralised into “Doctoral Training Centers”. It used to be whenever I applied for a grant I would add funding for a PhD. Now that’s forbidden, and instead most universities have little PhD funding, and a few have far too much.

This means most students don’t get to be integrated into a research group, and many supervisors get very little funding for students as their university doesn’t have the funding.
I'm not surprised the richest man in the world will commit all manner of sin, because one more dollar might be the one to fill that gaping hole where his heart should be.
> my retirement plan will be to get into another PhD program for the stipend/insurance

Imagine being a young ambitious student not getting placed into a PhD program because some old dude doing it for the benefits and the lolz took the spot.
Every once in a while I'll try LibreOffice out but I can never get past the UI. I've also never seen it in use at a company which begs the question: who is using it?
You should be able to add -- and comment out lines of queries. If not, this is a bug that I will investigate. Also you can use the Notes tab to store any past queries and findings.
The political right in Europe is not the same as the political right in the US. I am myself on the right side of the political spectrum and I despise Trump and more recently Musk. You can probably still find people that don't care, but they are going to be far, far fewer than 30%. Owning a Tesla has become something people apologise for.
Remember that Monzo is a UK institution -- ACH isn't relevant, and they can see the payment in flight if it's using BACS.

https://monzo.com/blog/2019/08/20/monzo-now-lets-you-get-pai...
Groundbreaking research is groundbreaking research regardless of how well it holds up over time. Obviously it’s been supersceded but that just demonstrates the vitality of the field.
The government forces companies to backdoor their systems and use compromised implementations of what would otherwise be private and secure systems (see for example https://en.wikipedia.org/wiki/Lavabit). It's also worth noting that the only thing preventing your searches being linked to your account via IP address and browser fingerprinting is to use Tor which conveniently will also not protect your from the US government either. Account settings can also link a person's searches to their account.

The good news is that while the NSA will absolutely be tracking everything you search for while using Kagi they also do the exact same thing with every other search engine you use so what difference does it make.
That's an incredible title!
Whether that's Banksy's identity or not, I'm calling it now: this is another Banksy publicity stunt / public performance. Not really sure what to call it, except perhaps art.

Andrew Gallagher is the next Mr. Brainwash. The whole thing is a sham and it will be revealed in spectacular form at the end of the trial, as briefcases full of confetti explode in front of the judge.

When Full Colour Black folds, it will enshrine the rights of artists within case law.
The way I feel about Kagi reminds me of how I felt about Google circa 1999.

The cynic in me wants to stop myself from becoming a fanboy because we all know how the story of tech startups goes and it's bound to repeat itself again; the optimist in me still wants to believe that there can be forces of good on the web.
It's horrible, incompatible, sluggish, slow and resources hog. Very bad UX.

OnlyOffice is leaps and bounds better.
Shame on you, Bezos. Hopefully my Kobo never dies (I’m on my third on e …)
thanks for sending me into that rabbit hole :)

I was already interested in polynesia, from quite a while ago, and had read some books about it, and also a great National geographic magazine series about ancient polynesian navigators, who did not have any modern instruments, they just used knowledge and observation carried across generations, of patterns of wind, stars, ocean waves and swells, sea and land bird movements, clouds, et cetera, to navigate thousands of miles across the Pacific, to both initially discover and settle, and later travel between, multiple islands and Island groups in the Pacific.

the hokulea saga is an example.
The problem with this idea is that deriving all the propagation and measurement functions and associated jacobians is 99% of the problem. Once that's done you can implement literally any filter from them using Wikipedia.
>> You are aware this patch introduced no code into the main kernel tree?

> It doesn't have to.

Ah, it's one of those other kinds of Trojan horses that don't enter the city walls.

> By becoming a single point of failure for all Rust drivers that depend on it, it becomes the responsibility of all maintainers of the kernel to avoid breaking it when they change the C interfaces.

So -- I'll ask what the Rust for Linux people asked Hellwig -- what is your suggested alternative? Where do we go from here? Is it Rust drivers not be allowed to common interfaces ever? In that case, what are the Rust for Linux team doing?

Or is it that you would like Linus rethink his decision re: adding Rust to the kernel? And if so, why didn't Hellwig make that case directly to Linus? What's with all this performative bellyaching on the LKML?
I've been scoped twice and the prep sucks. It's shitting your ass out for half a day. On the positive side, getting sedated isn't half bad and you get the day off work.
Ada's refusal to make their language any more approachable is a problem.
Yes, I was.

I suspect most PhD candidates who are considering a future career in academia are thinking about financial security after, not during. So if we're talking about why are there fewer PhD candidates...
Nvidia confirms RTX 5070 Ti release date for February 20, starting at $749
That's a different exercise though... wrong direction. Absolute pitch recognition is hearing -> pitch. What you describe is memory -> performance -> comparison <- hearing.
Wish we could have PowerPoint slides generated by phind. It already can generate the SVGs/PNGs. It's such a no-brainer to extend that to slides!

Maybe one day we'll have short clips generated by AI, something like 3Blue1Brown videos...
That's a good suggestion. I'm not sure if screen real estate won't be a problem though.
I'm not surprised. Right wingers will complain about anything not vociferously against the interests of the people.
The kernel is not CH's project. It's not his call to reject things he doesn't like anywhere in the kernel, including places he doesn't personally maintain.

Since Linus backed him up on this issue I’m left with the impression that Christoph is not a lone maintainer standing in the way of the inevitable march of progress; that his concerns are valid and shared by the founder and leader of the project and represent the views of other maintainers who preferred not to step into the ring on this debate.

Furthermore, the Rust code depends on his C dma code. That automatically makes it Christoph’s problem when something breaks, regardless of how many R4L maintainers come and go from the project.
That and they’d rather the small % of users that use the kindle for piracy keep doing that vs going to another ecosystem