skysight-inc/HackerNews huggingface dataset:
Started my career as an IBM SE for the mainframe in the early 2000s. They were desperate to bring young people into the mainframe world to carry the baton. My peers were all guys with kids my age or well older and most of them carried punch cards around in their breast pocket to take notes. At that time they were still abundant in random IBM supply closets across the midwest.
That's what controls are for, you're always comparing against the DMSO control. I also don't think anyone who's doing small molecule screens thinks DMSO is inert.
There was a Guy Steele talk a while ago on this topic. He also gives searchable names for some of the things (eg the ‘2d inference rule diagrams’). He calls it ‘computer science metanotation’, though I think it’s more of a PLT thing. https://m.youtube.com/watch?v=dCuZkaaou0Q
Key takeaway (after reading the headline):

“It seems I have to clarify my previous message. I'm stepping down as XFS
maintainer. I'm /continuing/ as a senior developer and reviewer for XFS.”
Since I don't drive, if I want to get somewhere that doesn't have public transport going there, are you suggesting I should not be able to go there?
In case anyone is wondering, yes, there is a cost when a model is quantized.

https://oobabooga.github.io/blog/posts/perplexities/

Essentially, you lose some accuracy and there might be some weird answers and probably more likely to go off the rail and hallucinate. But the quality loss is lower the more parameters you have. So for very large model sizes the differences might be negligible. Also, this is the cost of inference only. Training is a whole other beast and requires much more power.

Still, we are looking at GPT3 level of performance on one server rack. That says something when less than a year ago, such AI was literally magic and only run on a massive datacenter. Bandwidth and memory size are probably, in my ignorance mind, easier to increase than raw compute so maybe we will soon actually have "smart" devices.
So the idea is that you could do

1. send event data to depot

2. trigger localized ETLs (or put it high-priority in queue) to recalculate just the impacted data into relevant PStates

3. await completion of aforementioned ETLs

4. run query from updated PStates

Maybe too heavy for an upvote, but very appropriate for a an important transaction like a purchase.
Where does this expression come from?

I have a good example of "leap of faith". A close developer friend of mine decided to leave the development agency where he was working for fairly similar reasons. He then managed to find a job at a much bigger development company. He's still amazed that I have to wear 5 different hats when he's only wearing one, with no deadlines, just PRs and 3 times the salary.

I'll do it, maybe giving a bit more context and detail is important. But I don't want to take up too much of your time.
Honestly, I just need a cheat sheet for how to read the symbols using english words. I understand the concepts of the logical application of typing, but I don't read computer science dissertations regularly enough to make them the mapping of symbols to meaning stick.
An LA platform, made by Garrett's Mom
Especially with "the Denver stop" which has now been made legal in Colorado.

My son got clipped on his (human powered) scooter by a truck at an intersection the other day. He had a walk signal so the driver should have yielded. Instead, the driver plodded through his left turn, unaware that his neglect put him inches away from prison.

So, yeah; cyclists can roll through an intersection all they want but, I'm not doing it.
Generating an FSM over the vocabulary is a really interesting approach to guided sampling! I'm hacking on a structured inference library (https://github.com/gsuuon/ad-llama) - I also tried to add a vocab preprocessing step to generate a valid tokens mask (just with regex or static strings initially) but discovered that doing so would cause unlikely / unnatural tokens to be masked rather than the token which represents the natural encoding given the existing sampled tokens.

Given the stateful nature of tokenizers, I decided that trying to preprocess the individual token ids was a losing battle. Even in the simple case of whitespace - tokenizer merges can really screw up generating a static mask, e.g. we expect a space next, but a token decodes to 'foo', but is actually a '_foo' and would've decoded with a whitespace if it were following a valid pair. When I go to construct the static vocab mask, it would then end up matching against 'foo' instead of ' foo'.

How did you work around this for the FSM approach? Does it somehow include information about merges / whitespace / tokenizer statefulness?
Whose to say he hasn't already? Alexa is spyware.
Try https://www.sugarlabs.org/
Have you seen a Tesla?
Downvotes because the userbase here is rabidly supportive of any new "AI" tech regardless of the consequences, damage, or ethics surrounding it. But of course, we can never take a critical view of technology on Hackernews.
Who is still buying tower servers? Seems like a time machine back to the 90s but there must be a market....somewhere?
I feel more comfortable cycling in downtown Chicago than I do on suburban or country back roads. Nowadays, cyclists must worry about people using their phones while driving. Based on my observations of city driving, drivers are more aware of their surroundings due to the increased traffic and overall hustle and bustle. Drivers in the country often let their guard down due to the serene and idyllic environment.
This is a great tool. I’ve found it to be a great way to open large csv files that crash most gui programs. It’s now my favorite way to open csvs outside of the terminal.
Comparing with Google isn't fair, they are probably the company with the single most power over the internet out there.
It can be the smallest things.
Just the other day a CS professor was banned from a programming server for interviewing at the NSA 15 years ago. That was pre-snowden.

The bright side is that it's easy to move to a new server.
Insufficient capacity in the specific model? Two was wise but at end of life it's a mirror pair not a fault redundantly RAID set.

The 340s are old, and have had many cycles. They have 350s, 319 and 321s according to aircraft websites. And, the craft gave Merkel headaches in the past, causing German government officials to fall back on commercial aircraft.

They're both over 23 years old. They have had a lot of service life and were used by lufthansa commercially before entering government service.

https://simpleflying.com/germany-ditches-airbus-a340s-immedi...

They're 4 engine aircraft and so in some senses "safer" for longer range operations but that predates the current ETOPS capabilities of more modern 2 engine aircraft.

Americans will never operate Airbus craft for this class of service because of national chauvinism issues. It nothing to do with suitability. Proposals to make airforce one on an Airbus frame were very quickly shitcanned. I believe Boeing had some struggles to find frames to use for the modified 747 POTUS uses and in fact won't have some things the current jumbos have -in-flight refuelling might be dropped? The frames they sourced can't be modified easily/cheaply.

https://simpleflying.com/air-force-one-a380/
How would an LLM do prompt engineering for you? At some level, as others have stated, prompt engineering is about specifying the important details so the LLM can do the job. If you don't specify those details, how would the LLM know them? Some may be arbitrary and so whatever the LLM makes up might be good enough, but at the end of the day, you have to specify the important details.
> Is $15,000 really an "at home" sort of price?

For something that is... going to hallucinate? I don't get it?
The fine article says that the fines will be reduced based on the speeder's ability to pay, comrade.

I'm dubious of schemes that have disparate impact based on the target's ability to bring about change-- good at politics and paperwork? reduced fine. Not so good? continued death by 1000 bureaucratic cuts.

I'm also dubious of schemes that have low to zero enforcement costs, since the allocation of enforcement resources is one of the most important protections to assure that state intrusion is being directed to matters of actual public consequence.

I'm all for ticketing drivers who are putting the public at risk, but if the risk they're creating isn't worth deploying a citing officer is it really worth the imposition on the recipient of the citation?

and I'm also pretty dubious of schemes with latency and ones where you'll get tripped up without random local knowledge. Go to visit a friend in another city then end up with a dozen fines and a suspended license before you know what hit you.

... and lets not even get into the latent surveillance potential, mass monitoring people's movements on an industrial scale at low marginal cost.
To be fair, Ceres was considered a planet at one point and it is now the closest dwarf planet to Earth. So, in that sense it is a planet but it is not a major planet.
I don’t follow. A space program isn’t really relevant to transportation…
> Even when treated rudely, Bram usually responded only to advance his understanding of a problem to solve.

This admirable. Over time I've become a maintainer of one or two somewhat important open source codebases. One of the codebase owners that invited me to maintain their codebase, a very kind Swedish fellow, didn't know what kind of maintainer I might turn out to be, so when he invited me over beers he explained that a maintainer should be gentle with contributors the way a parent should be gentle with a young child when the child shows them a drawing they made. That image stuck with me. I don't know if I would have been a rude maintainer w/o that talk, but I often think of it, and I try to live up to that every time.
> to help build critical mass...

I don't know if you did that in purpose, but Critical Mass is the name of the San Francisco cyclist advocacy group

https://www.sfcriticalmass.org
this is unfortunately part of how they are used, especially in inpatient settings with way too high doses.

but also, if you've had a conversation with someone in active psychosis, vs. on the right dose of medication, there is a really incredible distinction in the clarity of their thinking and speaking -- night and day sometimes. so the drugs do work at genuinely treating some of the problems. and good psychiatrists do look carefully for this kind of improvement.
Thanks! I have started looking into integrations, but I can't overlay the dice rolls on another app without getting rid of the tray which feels like too much of a sacrifice. I will definitely do what I can to export roll results to other tools.
It’s a testament to computer science that this has been so thoroughly abstracted over the years
True. At least it gives us a range this way unless it's a block of ice or whatever else. I still remember some of this from rendering days.

H is basically the same as M, an absolute magnitude, but for solar system objects. Difference being that for solar system objects H, as you've noted, is an absolute magnitude for an object 1 AU from Earth and 1 AU from Sun in a triangle where phase angle is zero meaning it's a straight line instead of a triangle and M is an absolute magnitude for an object (usually self illuminating) outside of solar system set at 10 parsecs from Earth. A star with M = 1 and a solar system object with H = 1 would roughly be the same brightness. It's a log scale, lower the number the brighter it is, so if you put that star at the same spot as the object it'd be a difference of about 26 where each unit is roughly 2.5 times brighter. What's interesting is that at zero it used to (roughly) be Vega (star). Both M and H are band-dependent, I guess it's V-band (visual or green-ish) if it's not mentioned. If you have B (blue) and V band, the difference between the two tells you a (visual) color which can be also interpreted as temperature, the lower the number the bluer it is and higher means red.

I'm all out of trivia for the night. I'm sure there are (amateur and not) astronomers and astrophotographers here that know this stuff way more about. All I knew is that without albedo you couldn't get to the size with absolute magnitude alone, we could if we had both absolute and apparent. What I didn't know if that apparently there's a rough table of correlation between H and albedo values probably based on most rocks we've seen in space around us.
I started cycling again a few years ago.

I avoided taking the lane while I started, but after being forced into the gutter and nearly side-swiped multiple times, I started regularly taking the lane for my own safety.

That’s what really disappointed me about motorists as a cyclist - you give them an inch and they try to kill you.
Your number one priority is to avoid an early burnout. Your tasks may seem the most important thing in the world right now, but unless your start-up is curing cancer, it is probably not that important/urgent/crucial as they want you to believe.
>Where do you find information on what models you can use in the model_ckpt field? Do I need to import them from somewhere?

You can train (finetune) your own on your reference material.
Patents expire. I think the problem is making a good printer is not so inexpensive. And printing at shops makes more sense for many people.
> Completely pure P2P systems are hard to protect against Sybil attacks

I’m happy to report that P2P systems resistant to all kinds of attacks are implemented already. There are many, many solutions in many OS projects. See the technicalities of I2P or Freenet 2023. Safe P2P is possible, although hella hard to get right.
so...in a circle in the stadium parking lot when there isn't a game
If anyone needed evidence of this, they could look up how some ISP's (Like AT&T) chose to react to the TVPA act:

https://www.techspot.com/news/93754-isps-continue-charge-unf...

AT&T made it compulsory to use their gateways by installing certs for Auth on their hardware and just saying they do not offer for sale the same hardware and third party hardware could not (would not?) Be issued those certs.

I tried my luck buying a gateway off ebay and trying to get out of the rental fee. Their position was that this was "theft" as they did not sell these devices. Granted, I had to file an FCC complaint to even get that response. The exec I spoke with basically threatened me with legal action if I did not drop it.

Shady. They deserve to be replaced by muni or Federal internet indeed.
I worked on a previous iteration of Threads at Instagram, and I don't think the 25 person-years number you're estimating spent on the project was spent primarily on backend engineering. They concurrently launched native iOS and Android apps, and I think you're also factoring in the IC count from the linked article to mean full-time ICs dedicated exclusively to Threads, which is probably not how it worked. (Although TBH I'm not sure how you arrived at 25-person-years from the article, which said the project started with "dozens" of engineers and peaked at 50, and was 7 months long in total — a simple average of 24-50 engineers for 7 months, even if you assume they're all full time, would be about 21 person-years).

When I was at IG, my team was 20-something ICs full-time on our project, bursted to maybe double that as necessary in part-time help from ICs in the wider org. We had a total of three backend engineers, of which I was one, as well as a backend intern for a few months, although we bursted the backend team for a couple of months to four for some ML help.

Your project sounds pretty cool! But I don't think the comparison to Threads productivity is quite right. The majority of IG engineering is focused on building polished native clients, not generally on backend infrastructure. It's true that Meta already has a lot of the backend infra built — if Red Planet Labs can come close to what you get at Meta, that's pretty amazing. But I don't think the numbers you're quoting are apples-to-apples, or mean quite what you think they do. I don't know if this version of Threads operated exactly like the one I worked on (a Snapchat competitor), but I'd be pretty surprised if there was a product team at IG that was majority backend.

(Edit: I also think it's worth keeping in mind the experience levels of who works on these projects — at IG it's usually a smaller number of E6/E5s guiding a larger number of E4/E3s. Person-years are not all equivalent! If you spent ten years building the Red Planet Labs infrastructure based on your time at Twitter, nine person-months of your team's time building a product on your infra might not be the same as nine person-months of someone else's.)

Anyway — I don't mean to downplay your product, and really, if it's anything like the backend productivity I experienced at Meta, that would be pretty groundbreaking. Curious to see what you launch :)
Xbox introduces new strike system to curtail bad behavior
Agreed! But bike infrastructure is still important. Transit plus bikes are a great combo.
Pretty sure Amazon has been doing this since last year, as part of a cost cutting mechanism, that was also a "go green" push.
I hate cyclists when I'm in a car. I hate cars when I'm cycling. And I hate pedestrians when I'm walking, cycling or driving.
> It's impossible to keep everyone at a 80-90% busy rate at any large company just due to the inefficiencies a large system accrues, idling is embedded due to the many layers of communication, coordination requirements, etc.

Also, let's add another charitable explanation to this:

As people acquire more experience in the org, they become more efficient. That means someone who was maybe idling 20% of the time is now idling 50% of the time - they are simply faster and better at doing their job, but for whatever reason they haven't been promoted yet or assigned new responsibilities.

I don't know whether this is "good" or "bad".
> Whereas Twitter stores home timelines in a dedicated in-memory database, in Rama they’re stored in-memory in the same processes executing the ETL for timeline fanout. So instead of having to do network operations, serialization, and deserialization, the reads and writes to home timelines in our implementation are literally just in-memory operations on a hash map. This is dramatically simpler and more efficient than operating a separate in-memory database. The timelines themselves are stored like this:

> To minimize memory usage and GC pressure, we use a ring buffer and Java primitives to represent each home timeline. The buffer contains pairs of author ID and status ID. The author ID is stored along with the status ID since it is static information that will never change, and materializing it means that information doesn’t need to be looked up at query time. The home timeline stores the most recent 600 statuses, so the buffer size is 1,200 to accommodate each author ID and status ID pair. The size is fixed since storing full timelines would require a prohibitive amount of memory (the number of statuses times the average number of followers).

> Each user utilizes about 10kb of memory to represent their home timeline. For a Twitter-scale deployment of 500M users, that requires about 4.7TB of memory total around the cluster, which is easily achievable.

Isn't this where the most difficult(expensive) part is and Rama has little to do with it? It appears that the other parts also do not have to be Rama.
Capitalism. The answer is and will always be - capitalism. Capitalism demands growing profits. Until we get rid of the Cold War Propaganda, we'll never try to figure out better economic policies and systems.
The problem is all the rapha weekend warriors blocking roads. I’m a cyclist and a car enthusiast and so I straddle the line between both groups. Obviously cyclists are the underdog here but they aren’t all angels.
They only cost half a billion to apply for due to lobbying…
2nd - Chicago is regularly voted one of the worst cities to bike in - and I'm not sure how.

It's flat and - at least north of the Blue line - there's good infrastructure. Combine that with dense population, and the lake and tons of parks nearby, and it's the best biking city I've ever lived in.
I have a copy of this book. It is beautiful! There are few opportunities to see the precision and complexity of the basic components of modern electronics. If you like Ken Shirriff’s explanations of how discrete components are made on integrated circuits, this book shows how much bigger ones are made.
They might not be using nvlink due to selling on vast, someone could rent a single GPU out of the four available. No idea if there is some cross user security implication with nvlink in that scenario.
This project's been a blast to work with. While it's written in C++, it provides a C interface to compile against which makes it especially easy to extend with Go, Python and other runtimes.

A few folks and I have been building a tool with it in Go for pulling & running multiple models, and serving them on a REST API: https://github.com/jmorganca/ollama

In similar light, you haven't checked it out, llama.cpp also has a pretty extensive "server" tool (in its examples directory in the repo) with a web ui and support for grammar (e.g. forcing the output to be JSON)
I think "age: int" can be easily converted to English along the lines of "person's age: an integer". So the colon never bothered be too much.
> gives you the right to sue those who do.

This should be "gives you the liability to defend those patents."

If you don't have the money to defend, your patent is worth a shit.

And compared to Oracle or a similar evilcorp, you have no money. Which in turn means your patent isn't worth defending.

As a small business, a patent is only worth something if you aim to be acquired by one of the big ones. And it's a gamble.
It's not lobbying that's the problem. It's government corruption.
Small businesses in particular.

I remember back in the day working in companies of 15-40 people. There'd be ONE server. That ran everything you needed -- auth, DNS, file sharing, email server, application servers, web servers for internal apps, database server for internal apps. Usually sourced from a local MSP - or at least you had a support contract with them.

You didn't need a rack. You also had something that wasn't designed for a rack, so it could be in a secure back room with the switches, a UPS, a router, maybe some external storage... where it'd just sit quietly. Just has some big slow fans because that's all it needs.

Trust me, still a thing in small businesses, small retail stores, restaurants, etc.
Incidentally, I also hate cars while I'm in a car.
context: there are several instances that let you upload illustrations without a restriction on what content the image can contain, it can contain minors, rape, incest. These are instances are between if not the biggest and more active Maastodon instances. The reason why they are so active is because platform like Twitter while having a lot of these stuff too sometimes they will ban your account or at least shadowban you. Many Mastodon instances have banned these ones.

In my opinion instances should let the user decide what they find problematic or not and unless it's just spam they shouldn't ban instances.
One of those things is far more useful than the other - specifically the one that lets you travel at 50mph+ from point A to point B and has air conditioning.
The bifurcated risers mean that some of the cards are only running at x8 pcie speed as well, and they mention they are only working with pcie-3 not 4.

This would severely limit training using model parallelism.

For data parallel where the full model fits on each card and the batch size is just increased it wouldn't matter as much, and maybe that is the primary use for this.

I wonder how this is dealt with on vast.ai rentals. Because there is a huge difference if I needed 7x 3090's where I need all 168GB to load weights on a single giant LLM model vs. just wanting to run 4GB Stable Diffusion in parallel inference with a massive batch size....