skysight-inc/HackerNews huggingface dataset:
Show HN: LLaMA 3 tokenizer runs in the browser
You can sign into Graph Explorer and get an access token there:

https://developer.microsoft.com/en-us/graph/graph-explorer

No clue how long it lasts.
"may also" still doesn't suggest that the remote observers were doing all the work and the computer vision systems didn't work and it was all a farce though. spot checking that the system works isn't the same thing as doing the job of the whole system
The idea is good, but it should really include the 100 biggest islands, 50 biggest lakes, 200 longest rivers, or something along those lines.
They have a lot of precautions in place to avoid damaging any wild life. They move slowly, and their nets have special channels to allow animals to pass through and avoid getting caught.

See the "managing environmental impact" section here: https://theoceancleanup.com/oceans/

I imagine there must be _some_ non zero risk, but I imagine the benefits of removing the plastic outweigh the risk. Ie removing the plastic is better for the wildlife overall, despite the small potential risk.
For experienced developers, it helps a lot to know the names of companies that use Rails. Every time you see an unfamiliar company, learn a bit about how they used Rails, through the interview, if nothing else is available. We're to the point where we can ask nearly anyone fairly specific questions about their contributions depending on the history we see on the resume.

(I am not saying to avoid talking to people if you don't recognize the company.)
> Intel fab construction is exactly the kind of corruption we’re talking about here.

It's good when we do it, it's bad when China does it

> Trying to manipulate markets via subsidies is horrifically inefficient

By what means should markets be manipulated?
> repository of analyzed code

yes, this is obviously what you want. there shouldn't be a notion of 'running' the compiler; it should simply be a persistent process. importantly, there are two issues, which are orthogonal but both critically important: iterativity—that is, produce an acceptable result immediately, but then continue to refine it—and incrementality—that is, when making a small change to the code, take advantage of information learned about the previous version.

there is this recent paper on incrementality https://arxiv.org/pdf/2104.01270.pdf, though it has some caveats (e.g. it does not handle iterativity at all, so there is only so far it can go; can do much better)—but it is interesting non-technically because the authors work for amazon, so perhaps some of this is headed for industry
I opened this expecting the normal grungy tirade of intolerance & an general small & petty disdain for JavaScript. But there was the authors name and I knew this would be something different and higher class! And how!

I feel like the essence of this page needs some kind of rallying flag, some moniker. "Web first SPAs" or "browsing-compatible SPAs," something that can be made recognizable where the web dev tech hipsters can start pressuring each other & companies into doing the right things and not letting their SPAs break the web! This should be critical & visible drive in all web architecture, but its not notable as it's own thing, only seen in the absence of normal good functioning; having a good name to rally around & hype up in the noosphere feels needed.

> Maybe your single page app is different, but the ones that I know break most of my browser’s features, such as the back and forward buttons, page refresh, bookmarking, sending a link, or opening a link in a new window or tab. They offer no way to link to something that I look at. (Oh, I know there are exceptions to this rule, but they typically require effort — a lot more than many developers are prepared to invest).

> My main beef with single page apps, or SPAs for short, is that they’re not "on the web".

I do see a decent amount of reasonably well built apps, albeit most handle one or two pieces not perfectly. But there's also plenty of dark world dark pattern apps where things you click on aren't links.

(Subrant: this is also one of the things that drives me the most up the wall about PWAs. PWAs throw away most of the best parts of the web! Urls are quasi invisible, there's no tabs (unless the app builder specifically builds around Tabbed Application Mode), there's no forward/back buttons, nor bookmarks. PWAs ironically are as regressively anti-web as it possibly can come! They happen to be built with web technology, but obfuscate all web faculties the user might have. Piss on you PWAs, you are trash.)
Louisiana's flagship university lets oil firms influence research – for a price
Its definitely a really hard problem.

I think fundamentally the issue is you can't create trust out of nothing. Once you have something you trust, you can use cryptography to extend that trust in all sorts of complex ways. However you always need a starting point to bootstrap the system.

I feel like there is a big connection between this problem and trying to prove things in pure logic.

PKI is basically starting from axioms (i trust the following CA's as a starting point)

Tofu is the reflexive property - we know that x=x

Web of trust is some sort of coherence model (in the sense of https://en.m.wikipedia.org/wiki/Coherentism )

I think to make real progress on this problem, we need to make progress in epistomology.
Finally, solar energy that originates in space
A boss-less company seems ridiculous to me. Too many bosses is a problem, but so is too few.

People don't seem to understand that good bosses are partners, not tyrants. Their job is to ensure that you can do yours efficiently. Remove the boss and you will spend way too much time trying to find things to do, only to realize the other guy is doing them too, or do things you are no good at instead of doing the things you do best.

I think there has been experiments by communists of boss-less organizations, as it fits the ideology, but it didn't work well. Communism in practice becomes even more "bossy" than capitalism.
It would be unusual for a new college grad at any well-known tech company in Seattle to make less than $150k right now. Large companies like Amazon, Microsoft, and Google dominate the market here. If you were starting a software company in Seattle, $100k would probably be enough to interest only the most inexperienced and unqualified candidates.

New York City and San Francisco Bay Area are similar or higher. I don't have much experience with the rest of the US.
His reasoning is alright, his solution is bad, not sure if for the lack of knowledge of MPAs (like Astro) which fix the problems he is talking about.
> There are already nuclear armed “terrorist nations”.

There aren’t any nuclear-armed nations that have not, while being nuclear powers, been either practitioners of internal state terrorism (the original sense of “terrorist”) and/or sponsors of such regimes and/or of non-state terrorists working against their geopolitical rivals.
I had this job except I didn’t even get paid as a senior dev.
At the risk of this comment aging poorly, I am not convinced there is a magic GPT-5 around the corner, waiting to wallop anybody. I have a suspicion that we’re into diminishing returns with model scaling. All of the recent flagship releases (Gemini Ultra, Claude Opus, GPT-4 updates) have only advanced the frontier a little. Could OpenAI train something another 1-2 orders of magnitude bigger? Perhaps, but then it wouldn’t be economical to deploy it.
Thanks for the diagram TUI suggestions, good stuff to add. In my case, I select the text (diagrams) in the terminal and copy/paste them into my IDE as a comment block in the code or in Markdown.

Re: management - Gotcha! You mean some sort of container to manage the browsers maybe something like shift.com. That's actually great and I remember trying one of them but not sure what was the issue that I gave up on that. Anyway, this can be a path forward for this project.

And thanks for following, I did the same :D
Of countries which have experienced at least 1000 intentional homicides in a given year, NYC is comparable to Thailand, Zambia, Kenya, Peru in terms of murder risk
Not to jump too far down this hole here, but the only difference between an Ansible playbook, a Dockerfile, and postgresql.conf is format (indeed you're probably pretty likely to somehow jam a postgresql.conf file into your configuration-as-code tool, diminishing the distinction even further). The whole impetus behind configuration-as-code and containerization was to avoid having to bother at all with the host OS; my argument here is that we would've been a lot better off just figuring out how to configure--for example--postgresql.conf on Alpine Linux rather than inventing Docker and Kubernetes.

But! I will admit Kubernetes is handy for stuff like specifying scaling properties... but I mostly feel like conflating the two things ("configuring services" and "configuring cloud providers") was an oops.
This section of the article was illuminating:

But biology, like computing, has a bottom, and the bottom is not abstract. It’s physical. It’s shapes bumping into each other ....

Hemoglobin ... was shown to be an efficient store of energy because of how oxygen atoms snap into its body like Legos, each snap widening the remaining slots, so that it loads itself up practically at a gulp

Most proteins are like this. The ones that drive locomotion twist like little motors; the ones that contract muscles climb and compress each other. Cells, too, are constantly in conversation, and the language they speak is shape.

It’s keys entering locks: a protein might straddle the cell membrane, and when a cytokine (that’s a kind of signaling molecule) docks with it, it changes its shape, so that its grip loosens on some other molecule on the interior side of the membrane...
When I was at Intel 10+ years ago, they had this down to an art. They had a name for it, like, "the pool"; they'd reorg all the time. Everyone went into the pool, then the mgrs would pick teams. Your actual progress through your career was loosely tied to how quickly you were chosen. Especially bad IC's never got out of the pool; if you didn't have a req (or title) then you were let go after a year. This had the nice effect that mgrs rarely had to terminate employees: just wait for the reorg & don't pick out the bad ICs.
Tell us more about blocking ads on porn sites....
GitHub link: https://github.com/belladoreai/llama3-tokenizer-js
From 2016. SPAs have become much more annoying since then.
The whole discussion around that headline has always been so confusing. It's honestly unclear. What I'd like to know is, what % of actual costumer checkouts required a human being vs what % was 100% automated.

Some of the headlines and negative discussions make it sound like 100% of the checkouts required human approval. If that is true, then that's clearly terrible. If on the other hand it was anywhere below 5-10%, then I think that's a fair target for training the model in more difficult edge cases.

Something like Waymo also has humans constantly monitoring and helping, but I don't see much discussion about that being "controlled by humans".
Right along with a leather strap across the ass, no doubt. "MAN UP, BOY!"
Part of building an effective team is picking the right tool for the job, and your assertion that ‘genius’-wrangling is always justified / ‘the best thing to do’ is just plain wrong, no matter how much you try to justify it with…what basically sounds like Dunning Kruger self-flattery.

GP is right. So-called geniuses have their own problems. Problems that can’t just be ‘managed away’, just like you can’t completely ‘manage away’ some other types of poor fit. To say otherwise sounds like the sort of elite technical ability fetishism that, ironically, I’d expect from an IC.

If this has worked for you so far, it’s by coincidence.
Treating people decently is a part of social contract that no other animal can comprehend and accept, that's not playing with a ball, but that's not even the true reason this social contract exists.

The societies that have this social contract outdo those that don't, simple as that. If your version of treating animals was an advantage, Jainist countries would dominate the world. Yet they don't.
That would be my preferred option, too, especially if it allowed for things outside of school hours or locations more effectively, but it’d be a big change legally. School lunch is similar: arguably food insecurity should be dealt with separately but that’s a political minefield and so we have schools sending kids home with care packages over holidays because doing it directly is too hard to get through.
You mean it's technically impressive that SMIC was able to produce 7nm within six years of TSMC? Intel has been quite far behind.
The HN crowd probably knows that understanding maths concepts is a very rewarding experience. It is also very useful for $Nth grade, because it allows you to apply the principles to different problems than the ones you've seen solved.

However, if you try teaching a "bad at maths" kid how to solve a quadratic equation, explaining how to factorize and why it works is a bad strategy. They _prefer_ using the formula IME. They don't want to understand the concepts, they want to pass their exams, and rote memorizing the formula is a faster/more reliable way to do it.

I'll admit that maybe I'm just a bad teacher. After all, I'm not a teacher, I'm a CS grad who has done some teaching.

But think of the average class, with 40 students. The teacher needs all of them to learn to perform some tasks. He'll choose the one-size-fits all solution, even if it's less beautiful, less motivating for the kids that find maths to be fun.

I'm not saying we should go back to having schools for "gifted kids". They have well-documented problems, and I'm not at all qualified to pick one side of the tradeoff. All I'm saying is that boring biology classes are there for a reason, not just teachers without passion.
> government involvement in anything that could be done privately is by definition harmful.

They are religious extremists, kind of like the Taliban.

In my experience, they are not actually looking at data and are not ready to be convinced by deeper analysis, examination of natural monopolies, or examples of government successfully delivering something. There are a few in this very comment section
Why should one not protect his lifestyle? It was earned by a millions-year-long struggle to the top, I ain't giving it up to cows and insects.
Not just Seattle, I am seeing tech salaries in Denver, SLC, Austin, etc starting from 120-30k nowadays (and growing VERY fast if you stick around for a few years because the smaller cities have trouble keeping experienced engineers from taking a 700k offer from some FAANG company.)
Self-organizing = Lord of the Flies
We are on the same wavelength chris_pie. ch_sm is correct, it is a performance issue.

My first iteration of this was a chrome extension with ffmpeg.wasm, but there were multiple problems.

1. ffmpeg-wasm uses web-workers to attempt to parallelize the requests, but github has content security policies preventing the creation of web-workers from a chrome extension.

2. We can use the ffmpeg single core version, but the speed ends up being quite slow. I'm not 100% sure why but my best guess is because ffmpeg.wasm doesn't have access or take advantage of the computer's graphics card. The chrome extension background service worker is also only single threaded.

3. I did build a custom ffmpeg.wasm using Jerome Wu's blob as a guide to see if there was anyway to get the compression speed faster https://itnext.io/build-ffmpeg-webassembly-version-ffmpeg-js.... It worked, but was not faster.

The speed difference can be significant. i.e. On my M2 macbook pro I was getting 14 fps compression speed, compared to a 260fps compression speed using native ffmpeg.

This will vary, but I'd say around 5x to 15x improvement, similar to what ch_sm said.

The ffmpeg configuration I use is:
ffmpeg -i inputPath -an -c:v libx264 -crf 28 -preset ultrafast output.mp4

Feel free to test it out. If you want to test ffmpeg.wasm on the browser with web-workers, I have a work in progress demo page. The site is not updated yet, but at the bottom on the site you can upload a video and test the FPS of the ffmpeg.wasm on your machine. You will notice small <30MB videos get higher FPS than larger videos.

https://github-video-compressor.vercel.app/

The speed of the compression is important, because I wanted the whole compression + upload to be faster or take just as long as uploading the actual file. This does depend on the computer resources and internet speeds.

By using the native ffmpeg binary, we get the fastest speed possible. I tried a bunch of ffmpeg configurations, this was the fastest one I found that works consistently. Let me know if you anyone knows a faster one.
I guess that's better than nothing, but the Kylin WeChat binary is from 2021, so it's not evidently a first-class option.
Thanks for testing it out flamejob!
I think it's hardcoded into h5ai. I am not logged into github, so I can't use regular code search, but it seems to refuse to serve anything under $APP_PATH.
I feel that this argument is pretty outdated at this point.

Most new SPAs people build use frameworks like NextJS that solve all of the big complaints.

Sure, there's plenty of old, crufty SPAs from the pre-react-router days still out there. I also dislike those apps.

I guess my point is... there was a time when you could blanketly hate SPAs and be mostly right about the category. And you could be mad at a company for even daring to try because they were very likely to screw it up. But I think we are now past that period. SPAs are now pretty awesome and fast and good!

Edit: ah, this article is from 2016. Which actually was a very valid time to hate SPAs! Maybe this is a good moment to applaud the hard work of folks at Vercel for fixing the problem :-)
I do sometimes think a self organized hierarchy is better than one organized by fiat. Everyone always will say, "Ah - but then you just get an implicit hierarchy rather than an explicit one" with these types of systems but this isn't necessarily a bad thing. For example, There shouldn't necessarily be one escalation channel for all types of conflict - technical decisions may get resolved differently than intra-personal conflicts.

Or, if you force a team to be under an incompetent leader in a traditional structure, you get a really unhappy unproductive team but in an implicit structure that 'leader' is quickly sidelined when people figure out the quality of their decisions are poor, and if they want to get things done - which most do in a properly incentivized org- they should find another path.
I’ll buy that 400-500k a year is average for Facebook, Apple, Google, etc.

It’s absolutely NOT average for companies who aren’t the massive giants that those are. I’ve been in actual tech startups, not Uber for Clowns, and the best salary I’ve seen was an (admittedly very good) $170k for a senior dev position. That’s close to average when I talk to my friends and associates in tech in the valley and beyond.
Well, this place is called hackernews, after all. Information should be free so if Youtube makes it public, public it should be.
Is it really an edge case these days? A user’s very first sync is likely to be the largest one, to seed all the data into the could. That could easily be thousands of files.

Installing on a desktop, laptop, and mobile device would bring 3 clients into the mix right away.

So the user’s first use is likely to be one of the more complex operations, and the one they absolutely needs to work, as a failure here will lead to the user looking elsewhere for a solution.
There's more than one way to do it.

How I work:

- First I make a very general design of modules, taking into account how they are going to communicate with each other, all based in experience with previous systems.

- I foresee problematic parts, usually integration points, and write simple programs to validate assumptions and test performance.

- I write a skeleton for the main program with a dumbed-down GUI.

From that point on, I develop each module and now, yes, there's a lot of thinking in advance.
I would have put it differently, but your use of “average” made me wonder what you were thinking as well. I’m still not quite sure. You’re not a hypothetical person whose salary and job prospects are unknown to… you. If you’ve received job offers locally and overseas that would be interesting, but what you’re talking about sounds like speculation.
Okay that's a fair point. Anyone who boasts about how good they are at something should probably be treated skeptically to say the least.

Kinda like how any politician that says they're some pillar of morality turns out to be anything but that.

Purely providing advice about something or marketing your skills isn't quite the same thing.
If we have to nitpick over a few dollars down to that level of detail, I think we can all agree it's not a particularly high paying job.
The pushing starts when the ones a few rows back want a closer look... might not be deliberate or premeditated.
Do biometrics use actual fingerprints or biometric template? I.e. you can revoke template and issue a new one?
> understand when the effect occurs requires examining the type signature of every function that is called. Since this is meaningful control flow, it seems very valuable to be able to identify points at which an error occurs without examining the signatures of each function call.

This is currently the case in rust. IO and other effects are frequently implicit. You don’t have to use ? or await they are *sugar. I have frequently seen reinventions of exceptions, unwind nonsense, adhoc interpreted tagged effects, etc..

Explicit syntax for effectfull calls should not be a goal. We don’t actually have that today.
We Work founder and marc andreessen's favorite founder: adam neumann
> Maybe your single page app is different, but the ones that I know break most of my browser’s features, such as the back and forward buttons, page refresh, bookmarking, sending a link, or opening a link in a new window or tab. They offer no way to link to something that I look at.

In my experience, this is very simple when using the Angular Router.
Indeed, it's difficult to not get it working.

https://angular.io/guide/router
> I personally think that a hybrid system is best. The government should build and maintain the physical infrastructure like fiber and cell towers, and private industry should be able to access this infra at cost + a small fixed markup and provide all other needed equipment and services on top of that infra.

I fully agree and am on board with this. I liken this to a “public roads” approach and (in applicable countries) a nationalized rail system. So many businesses are successful operating on publicly-owned infrastructure without the burden of maintenance. However, if everyone had to maintain their own infra like that, this same burden creates a high barrier to entry for new companies, promoting a monopoly, which leads to a situation where there is non need to compete or innovate: Build once, bill forever.

In my city, Sacramento, the collectively owned power company (SMUD) owns all the power poles and regularly sells space on them for telecom with little restriction. For internet service, I have the option of 2 different FTTH ISPs, 2 DOCSIS ISPs, and 1 DSL ISP (which is 2-3 more options than many people have). Not perfect, but it does mean there is healthy competition and customer choice. I just wish SMUD would run their own PON and sell bandwidth on it, we would then see a number of ISPs pop up and ISP-adjacent innovation utilizing this (hypothetical) city-wide PON as a platform.