skysight-inc/HackerNews huggingface dataset:
I implemented a hierarchical model that pooled utf8 encoded sequences to word vectors and trained it with a decoder on text denoising.

I think the future is a small word encoder model that replaces the token embedding codebook.

And here’s the reason: you can still create a codebook after training and then use the encoder model only for OOV. I’m not sure there’s an excuse not to be doing this, but open to suggestions.
Exploring GitLens: 12 Features to Enhance Your VS Code Setup
> But you can break this into a different problem knowing that 2^3 = 8, and doing 7*2*2*2.

Doing that multiplication all the way through is super slow. When they said "can't" they meant in an effective sense, since they did mention repeated addition as an option. And that's not an effective way to get there.

> There are other ways of seeing the multiplication table as well. For example 9 times something can be thought of as 9*x = 10*x-x.

Yes, you can do that one. But that's just about the only fast trick there is.
> primary issue is that there is no means to correct the situation non-violently

Are you a regulator voter? Do you have a dialogue with your electeds’ offices? If not, try starting there. Express, as unemotionally as you can, why you believe this is something you believe in. If possible, get your views seconded in writing.

If you’re in America or Europe, there are plenty of non-violent remedies at the ready. The problem is privacy is uniquely afflicted with the uselessly cynical, to the point that it’s considered electoral junk at the national level.

> What we are seeing today is the same thing East-germany saw under The Stasi

Please don’t do this. It’s one step below analogising petty complaints to Auschwitz. (Archer can do it. You can’t.)
Thanks I’m thinking about golang, I don’t know we will see.

Thanks for your advice!
Most ERs have a fast track area dedicated to this kind of thing.
I think this is all too common due to a small few who take advantage which leads to the construction of barriers to prevent abuse. This isn't limited to large orgs -- it's everywhere in society.

I suspect accountability without authority might not be as accurate as one might seem when there exists middle management. You might be accountable but your boss probably is more so, thus the reluctance in giving full autonomy. They of course won't be able to take credit in that case either :). Perhaps an overly cynical view I admit.
It's pretty new though, and it's a bit rough around the edges still. The other issue is that almost every single package/library for pyside6 only supports QtWidgets, not QML. Meaning you wouldn't be able to use tons of libraries that make up the python qt ecosystem (for example, pyqtwidgets or vispy). Not a huge dealbreaker but it's something to keep in mind.
Better version with inline images:

<https://www.smithsonianmag.com/history/how-the-rise-of-the-c...>
> I already know what the reaction to this essay will be. Half the readers will say that Microsoft is still an enormously profitable company, and that I should be more careful about drawing conclusions based on what a few people think in our insular little "Web 2.0" bubble. The other half, the younger half, will complain that this is old news.

With 17 years of hindsight to our benefit, my reaction is both of these things at the same time.
What are you actually getting at with this? Formalising algebraic topology in Lean is still _very_ much an open project, for instance.
>Except ... it doesn't.

I take your point, but "all" in my comment wasn't intended to be taken literally. In fact, your list could've actually been much longer, but the point is that all of these parties must find a way to express their preferences through one of the two predominant parties—or not at all.

>If it appears to "fit" into two political parties, that has more to do with what aspects of American politics appears in whatever media you see, which in turn reflects both the formal powers of those two parties

In practice, it actually does fit into two political parties, by definition and for exactly the reason you mentioned: they are the only two parties with the formal power to compel the media to express their will. How did that come about in a nation that supposedly embraces individualism?

I didn't intend to say that there are no individualistic beliefs in the U.S. I'm saying the idea that individualism is a dominant or defining characteristic of the U.S. in any practical sense is largely a myth. The overwhelming majority of Americans are happy to fit themselves into one of two political parties. That includes the party that fancies itself one of "rugged individuals", while its members adopt a laundry list of exactly the same beliefs.
Only if your cat doesn’t love to eat packaging tape
A company I worked for had a lot of Ukrainian developers (who were mostly pretty good) and well, that had a tragic outcome. That kind of thing is a risk no one saw coming.
Gemma 2 on AWS Lambda with Llamafile
A small experiment to see if we are there yet with highly virtualized CPU compute and Small Language Models (SLM). The answer is a resounding maybe, but most likely not. Huge thanks to Justine for her work on Llamafile supported by Mozilla. Hope folks find this R&D useful.
This is especially true when you use a lot of tooling. I love jupyter, but installing it in a venv means pulling a lot of deps which will affect a lot what I can install.

Fortunately the Python community is much more serious about making deps that work together than the JS community, and the fact it works at all given the cartesian products of all the python modules is kind of a miracle and a testament to that.

Unfortunately, that's a problem that is unlikely to be solved in the next decade, so we all live with it.

The reverse problem is true for JS, and I see many projects shipping very heavy frontend code because despite all the tree shaking, they embed 5 times the same module with different versions in their bundle. That's one of the reasons for the bloated page epidemic.

I guess it's a trade-off for all scripting languages: choosing between bloat or compat problem. Rust and Go don't care as much, and on top of that they can import code from 10 years ago and it sill works.

However, and while I do know how hard it is to ship python code to the end user (at least if you don't use a web app), I don't think the version problem is the reason. We have zipapp and they work fine.

No the main reason iscompiled extensions are very useful and popular, which means packaging is solving more than packaging python, but a ton of compiled languages at one. Take scipy: they have c, pascal and assembly in there.

This can and will be improved though. In fact, thanks to wheels and indygreg/python-build-standalone, I think we will see a solution to this in the coming years.

I'm even betting on astral to providing it.
But isn't that just a plain old straw man?
Well next time you are in Cranbrook feel free to drop me a note if you want to grab a coffee or beer. My contact is in my profile.
PowerNotes: Scientifically designed to create high quality research
Using Analogies to Perform Better Under Pressure
Canada has also experienced record rates of recent population growth, so even at historically normal building levels (which are artificially suppressed) there would be a lag time between demand and availability.
To solve this problem recently, I just defined -1% as 'not at all' and 101% as 'all of it' .

But then, I'm a Unix hacker. ;)
I agree, though I would prefer a solution that actually leads to the weakening of the oligopolists.
What are you on about? They publish their research advancing the field. And gemini has caught up with openai and anybody else.
Our Man in Havana is a very good book about the topic.

Secrets are a dark illiquid market where there’s high demand for things that don’t exist. So naturally there’s a lot of supply for that information. The fact that is almost all bogus is irrelevant.
Yeah don’t have your hopes up, but Shirley Meng is well known battery researcher, it’s not complete vaporware.
Ok, thanks for letting me know.

> Microsoft's Windows was the dominant desktop operating system (OS) worldwide as of February 2024, with a market share of around 72 percent.

https://www.statista.com/statistics/218089/global-market-sha...
Great tip in the article to not punish your cat when it does something wrong. It just gets worse when you do that. Learned it the hard way after once yelling at mine.
Same. I quit Google to go work at a 4 person company. I love that we’re just able to get stuff done. Hard to get GPUs? Walk down to Central Computers in SOMA and buy L40S cards and build a workstation for everyone to share.

I’m not very financially motivated. I’m already making more than 90+% of the US. I just can not fathom the level of greed I saw hiding behind people’s eyes at Google as they try to build empires. I’m in Silicon Valley to learn about and work with computers. I get to work a chill number of hours while still learning every day. If you could get a lot of employees like that you’d have a huge market advantage.
What about paying American salaries to talent in other countries? A wider talent pool is good for everyone, because in the long term it means the best developers can demand more. Top talent doesn’t negotiate based on their cost of living.
> The emergency room (ER) is the front door of the hospital. Patients come and are quickly seen by a physician, who addresses medical emergencies and other needs.

There it is. The ER, even with its shortcomings, is a better user experience. You have a medical concern, and you get it addressed in a reasonable time— not the weeks or months you need to wait for your primary care or a specialist to be bothered to see you.
I use math to decide which bus to take to get home.
He apparently said this:

"If wearing certain clothes is a sin, the behaviour towards women and girls is 100 times a greater sin. Nowhere in religion is there any permission to confront someone because of their clothing."

https://www.bbc.com/news/articles/czvxg4ww511o

So maybe he's relatively soft on the whole execution thing.
Through the Eye of a Needle: A Perspective on the Renewable Energy Transition
This came up on an interview test where I had to implement this from scratch! Fun to read
To be fair, I'm kind of amazed that humans can do basic arithmetic at all. Our attention spans suck. We're barely trustworthy on single digit addition. For anything more complicated I use a calculator.
Motor OS website is now served from Motor OS VMs
Amazing how wrong Paul Graham was on this despite claiming to be an expert in tech companies.
My immediate thought after reading the question was also the very last sentence of 1984. It was the first time that a book caused me to feel a deeply visceral, lasting emotional response. Reading through the first 99% of the book, I found it a well written and engaging book, but all of that just lead up to the very last sentence. It absolutely hit me like a truck. I also just sat stunned after finishing the book.
Google is dead.
The existence of code in otherwise "dumb" toasters is due to it being cheaper than the analog alternative, simple as. I'm not sure why we're talking about all of these things as though they only exist to keep programmers employed.
You can only think using memory.
Open Source
Hello,

I’m a junior frontend dev looking to contribute to some open source projects. Does anyone have anything they need help with?
John Oliver (I know, entertainment, but still) did a segment on this, although around the low end stores, like Dollar General. And they do exactly this. "Ever wonder why it's chaotic? Because many a time DG will literally schedule only two, or even one, employee to the shift. And they're on the register, so shelf stocking, cleaning is not on their agenda."
How Does Open Source Software Become Profitable? [video]
Abstract

­­> We add to the emerging body of literature highlighting cracks in the foundation of the mainstream energy transition narrative. We offer a tripartite analysis that re-characterizes the climate crisis within its broader context of ecological overshoot, highlights numerous collectively fatal problems with so-called renewable energy technologies, and suggests alternative solutions that entail a contraction of the human enterprise. This analysis makes clear that the pat notion of “affordable clean energy” views the world through a narrow keyhole that is blind to innumerable economic, ecological, and social costs. These undesirable “externalities” can no longer be ignored. To achieve sustainability and salvage civilization, society must embark on a planned, cooperative descent from an extreme state of overshoot in just a decade or two. While it might be easier for the proverbial camel to pass through the eye of a needle than for global society to succeed in this endeavor, history is replete with stellar achievements that have arisen only from a dogged pursuit of the seemingly impossible.
I think foreign competition has some unique features that are beneficial:

— cross pollination of talent, knowledge, technology, etc;

— less susceptible to being eliminated when a future government caves on some of the rules you’ve mentioned
> Why aren't there facilities out there that just specialize in the elective surgeries

There definitely are. But I wonder if the main sticking point may be access to an ER in case something goes terribly wrong during surgery. I know that gets used as a bludgeon against abortion providers, but I imagine the same basic regulations apply to any clinic offering surgical services.
> Training data is the competitive edge, so everyone refuses to elaborate about what they use.

I absolutely understand it, thus curiosity about some leaked insiders knowledge or anything. Anyway, given availability of these huge data sets (incl. ones you mention) and advancements in processing techniques, we probably have a long way to go. Also, video looks like two guys talking about everything except AI bubble.
Even at 100 cycles it’s likely cheaper for some applications - i.e. helicopters.
Non-causal link but 8x times the risk off of one study at MGH seems to be the eli5.

I made my comment about dependency on these class of drugs a while ago on hacker news but I’d love to see a regimented system that helps patients eventually get off of these drugs or otherwise it seems like we’re trading one con for another (albeit much lesser).
>> The problem is not having the imagination to make something out of not much.

I have over 20 years in scout and youth leadership, orgs full of of near-professionals at imagining stuff for kids.

We thought a lot about our own childhood development space - our daily hours of safe [from cars,karens,cops], adult-free time.

And we continually examined kids options for the same.

Skipping to the end: Modern kids' options are so limited it rounds down to nothing.
This is IMO a great example for React and declarative programming.

> There's no special concept to understand

By not understanding that you need to cleanup timers when your view unmounts, you've introduced a subtle bug that your coworker will discover in 6 months when users report that the counter sometimes increases twice as fast.

I've worked on Angular-like apps before, and storing and cleaning up timers was always a pain point:

private timer
private someValue = 0

onMount() {
timer = setTimeout(() => {
someValue++;
setContent(<p id="some-element">value is {someValue}</p>)
}, 1000)
}

onUnmount() {
clearTimeout(timer)
}

React on the other hand, clearly defines the concept of an effect as something that is initiated after the component renders and then cleaned up. You also keep the setup and cleanup close together, so you don't need to manually store the timer handle.

const [someValue, setSomeValue] = useState(0)

useEffect(() => {
const timeout = setTimeout(() => {
setSomeValue(v => v + 1)
}, 1000)
return () => clearTimeout(timeout)
}, [])

return <p>value is {someValue}</p>

People often criticise useEffect for being hard to grasp, but it is the perfect essence of how to manage, well... effects in a component-based system.

That's why Vue and Svelte have the same thing:
https://vuejs.org/guide/essentials/watchers.html
https://svelte.dev/blog/runes
My ideal situation is that the system should maintain authoritative versions of every package and version that is ever requested, and they should not need to be shipped. Multiple versions of a package should coexist.

/usr/lib/python3.12/torch/2.1.0/
/usr/lib/python3.12/torch/2.1.1/
/usr/lib/python3.12/torch/2.1.2/

When a package requests 2.1.1 it fetches it right out of there, installing from PyPI if it doesn't.

The same should be true of JS and even C++. When a C++ app's deb package wants libusb==1.0.1 it should NOT overwrite libusb-1.0.0 that is on the system, it should coexist with it and link to the correct one so that another app that wants libusb-1.0.0 should still be able to use it.

> Fortunately the Python community is much more serious about making deps that work together

This is very not true at least in ML. I have to create a new conda environment for almost every ML paper that comes out. There are so many papers and code repos I test every week that refuse to work with the latest PyTorch, and some that require torch<2.0 or some bull. Also, xformers, apex, pytorch3d, and a number of other popular packages require that the cuda version that is included with the "torch" Python package matches the cuda version in /usr/local/cuda AND that your "CC" and "CXX" variables point to gcc-11 (NOT gcc-12), or else the pip install will fail. It's a fucking mess. Why can't gcc-12 compile gcc-11 code without complaining? Why does a Python package not ship binaries of all C/C++ parts for all common architectures compiled on a build farm?
It's almost as if we shouldn't treat their words as gospel. By them I mean people who were in the right place at the right time and had the right amount of luck, which is what success looks like usually.
What is Markdown? (a.k.a. ".md" files)
GPT4 has seen lots of base64 text. GPT4 has never seen text split in a place where its tokenizer wouldn't place a token boundary. In the worst case, this produces an undertrained token that throws the model off completely, SolidGoldMagikarp-style.

You've probably never tried to memorize the four-letter base64 equivalents of dGhl 10000 most common three-byte substrings. But you've seen plenty of truncated text, as you were typing it into a textbox yourself. So your intuition which of these tasks is easier for GPT4 is likely off.

The issue with truncation affecting tokenization can be worked around by considering every possible continuation that would lead to a different tokenization of the current prefix, and then sampling from those according to the model probabilities to get back to a more normal token stream.
Photos on your #content are a well documented #engagement #enhancer.
To maybe help you alleviate a small bit of your presumably nearly overwhelming confusion I will repeat my reply to your SEC question[1], if that is indeed the 'first' one you ambiguously refer to.

> When SEC approved Enron's change in account reporting practices from historical cost to mtm, I would argue that the SEC failed it's mandate to protect investors by allowing disingenuously optimistic instrument valuations

I'm not sure what about that you think is evasive but I'd like to end the conversation here regardless.

[1][Whats] one example of something the SEC had a mandate to do that it didn’t.
Many sites stupidly only allow you one passkey or FIDO U2F key.
A Critique of ANSI SQL Isolation Levels
Does Ashton Kutcher ring a bell? https://fortune.com/europe/2023/09/26/thorn-ashton-kutcher-y...
Summary: It’s not “dead” in the sense that it’s defunct but it’s a mere shadow of its former self.

The leaked memo of between Bill Gates and his C-level executive(s) is an iota of the level of nightmare at MSFT.

https://www.syracuse.com/technofile/2008/06/bill_gates_someo...
Related: https://docs.github.com/en/get-started/writing-on-github/get...
They will seek more surveillance because the majority of the citizenry desires safety and a competent and efficient government over personal freedom.

We continue to have societies because the average person realizes that their life would be better on average if they outsourced their personal security to the strongest third party available. Until this third party becomes inconveniently corrupt.
Debut single:

Lyrics Born - Calling Out https://www.youtube.com/watch?v=2-kV6TRs8PU

Um. Just did a quick stroll down memory lane. Ya. Me Phi Me's album ONE hasn't exactly held up well... So here's another movie soundtrack single that I still enjoy:

Me Phi Me ft Jeriko One - Here We Come https://www.youtube.com/watch?v=bQsmJif3RTA
I only hope it brings about more integration of our vast amounts of data instead of more generative inaccuracy
Even freedom to practice religion and the ability to own property rely on someone delivering the service of protecting that right (i.e. police, the courts, and the military). In that respect they aren't really any more inherent than other rights like medical care or food.
Scalable Reader-Writer Locks (2009)
What Paul wrote in 2007 could be true, while what you wrote about Microsoft in 2024 could also be true.

Microsoft changed. And for the better. The death was short lived, but in many ways, especially in the cultural zeitgeist of software engineers and tech folk, Microsoft did die there for a bit. Satya did a great job of resurrecting it. He has been masterful in his role (I worked at a company that was acquired by Microsoft).

Companies who were once the 900 pound gorilla can die, despite making a lot of money. Oracle still prints money, but how many people under 50 use Oracle on a day to day basis when they are building a company? I would venture to say approaching zero. Google is still printing money, but in many ways it is dead (or dying).
I think the title was (perhaps intentionally) overstated, but the content of the essay is correct. The better title (in the sense of more accurate, perhaps not for getting clicks) would have been "Microsoft Is The New IBM". And that is still true.
And it doesn't provide any way to use a link to any other package repository if you want to stick to vanilla pyproject.toml + build (the official build tool). So if you want to use the CUDA or rocm version of torch, for example, you have to add a direct link to the package. That means that you'd have to hardlink to a platform specific version of the package. There's no way to just make a package look at a non pypi repository to get the version you want otherwise.

So say you want to add pytorch, with GPU acceleration if it's possible on a platform. You want to make it multiplatform to some extent.
You can't add another index if you want to use vanilla build, as that's not allowed. You can add a direct link (that's allowed, just not an index) but that's going to be specific to a platform+python version. Pytorch doesn't even provide CUDA packages on pypi anymore (due to issues pypi), so you need to be able to use another index! You'd need to manually create requirements.txt for each platform, create a script that packages your app with the right requirement.txt, and then do it again whenever you update. Otherwise, I think the most recent advice I've seen was to just make... the user download the right version. Mhmmmm.

The other option is to use poetry or something like that, but I just want to use "python build . "...
You cannot do wild camping in Holland?

You can probably camp on Piccadilly Circus if you have graffiti skills like mine. Policewagon or Garbagebin might work.

https://photos.app.goo.gl/xKXuoi4SxTkU9kev7
Paul Graham is dead
What the quiet eye tells the quiet brain: Linking perception and action
What we know about microdosing candy illnesses as death investigation underway
He was impeached, and every single politician voted on party line, the whole GOP is 100% corrupt (if you agree he clearly did do it)
impeachment is not a useful tool in this situation.
To be fair to Paul, Microsoft does seem to be a zombie like company, at least the Desktop division.