skysight-inc/HackerNews huggingface dataset:
Exa is one of the first utilities I install when doing a new installation on macOS or FreeBSD.

I don’t mind a fork was necessary; that’s pretty common with open source projects. Looking forward to eza.
I hope this is only a slight tangent; since the authors talk about their model serving throughput and I hope I can get a gut-check on my understanding of the state-of-the-art of model serving.

The success of ChatGPT and my current work has had me thinking a lot about the "product" applications of large language models. I work at Pulumi on www.pulumi.com/ai; it's a GPT-3.5 and GPT-4 interface using retrieval augmented generation to generate Pulumi programs, and user experience is top of mind for me.

(Fingers crossed this doesn't hug our site to death here for the reasons I'm about to explain.)

To be blunt: I have found it surprisingly difficult to find the right tools to host models without dramatically worsening the UX. In theory we should be able to fine-tune a model against our own SDKs and synthetically generated code to improve the model's output and to guard against hallucination when retrieval fails. In practice, self-hosted model serving APIs have really poor time-to-first-token or even completely lack streaming behavior. It's a non-starter to build a product on something where a user has to sit and watch a spinner for a minute or more. I've been looking at the vLLM project with great interest, but haven't found much else.

---

For folks in MLops, deploying models with streaming APIs:

1. Is it mostly accurate that none of the model serving tools created prior to ChatGPT are great for streaming, interactive use cases?

2. How are you currently serving these models as an API and what upcoming tools are you exploring?

For the authors: How does your inference optimization compare to vLLM, or other tools using techniques such as continuous batching and paged attention?
"Sophomoric" was never a compliment.
Ah, gotcha - I assumed that if some document said you couldn't use something for some purpose and you decided to use it anyway it would be considered theft from the intellectual property owner.
A long running story is that engineers have great starting salaries compared to many other fields of study, but they don’t get raises to the extent that people in other fields do. To some extent engineers right out of school are in demand because they are educated in the latest technology and that’s valued more than experience.
Ask HN: What’s Happening with WeWork?
Does your company still rent their office from WeWork?

Do you work from WeWork spaces?

What’s the atmosphere there?
Never equate commercial impact with scientific breakthrough.
Paddington 2 is legitimately great though.
A collaborative effort to name every color in the RGB/web space
I'm not sure who needs to ask that question. Apple gets critical vulnerability reports and investigates them.
Building Llama.cpp on a Windows Laptop
Here are the steps I took to build llama.cpp on my windows laptop. I hope this is useful and all feedback is welcome.
no copyright transferability

The economic part of copyright is transferable in the EU just as it is in the US, only certain moral rights (such as the right to attribution) are inalienable.

edit to add: it's not just in the EU. According to Wikipedia, the same distinction is made in Brazil, China, India and Indonesia (among others, but those were a few big countries that stood out).
What do incels need the pity of the Financial Times for, or anyone else?
You won’t really find anything interesting from this repo aside the update functionality that was likely used for downloading the payload. The topic of interest is the payload that TAG obviously can’t disclose because vendors are fixing whatever bug was behind this 0day

Unsuprisingly, TAG is light on details..
Well, OpenAI was the first to bring fire to the masses. Until then, it was a story described behind closed doors. Google wouldn't let you touch their stuff. Meta wouldn't let you touch their stuff. But OpenAI gave us an API. They were open-access first.

Now, of course, Meta and Stability have given us so much more. It's a good time!
Hey, thanks for your interest. I think it's interesting that you think I don't care about things like whitespace vs braces? In the Lex interview I was kidding around, but I assure you, I do care.

Braces are strictly worse than whitespace indentation for several reasons. Brace-based languages:

1) Generally have the "dangling else" set of ambiguities.
2) Some (e.g. C) allow but do not require braces which leads to style debates. The ones that require braces are more verbose.
3) Require more punctuation clutter, and consume more vertical whitespace in practice.
4) ... use braces that are completely redundant with indentation in practice!

It's super funny to see people defend curly based languages. Using curlies but not indenting properly is almost always a sign of a bug (e.g. clang has warnings for this sort of thing due to the "goto fail" and other debacles.

That said, as you also know, Python compat is not optional for us, so Mojo doesn't actually a choice at all here. I find it amusing though that your post acknowledges thoughtfulness in language design and thinks this is an example of a lapse of judgement. :P

-Chris
No number does, at least by the usual way of writing them.

https://gist.github.com/mminer237/926bc453a9e09b2a2803305c5e...

Even in the millions, few gematria sums get above 800, so it's not as hard to figure out as it seems.

Two numbers are one off, though I won't spoil them here.

There is a match if you include "and" though.
If we are to believe the hypemasters selling AI risk, it will increase profits across all industries by making human intellectual labor ("knowledge work") redundant, allowing the economy to operate at current output with a fraction of the labor

(the question becomes, once everyone is out of the job, who is paying for goods and services to keep the economy alive, hence - basic income)
Apparently it has before. Although not sure of this specific exploit.

https://techcrunch.com/2023/04/18/apple-lockdown-mode-iphone...

CL link : https://citizenlab.ca/2023/04/nso-groups-pegasus-spyware-ret...
Some of the problems with iMessage have to do with the fact that it's integrated with the system SMS app. It seems that there are a large number of legacy requirements in the GSM spec that require the Messages app to be privileged in some way, especially with regards to automatic processing of data received. There have been plenty of iMessage or Messages related vulnerabilities.

I do wish there was a way to turn off automatic downloading of attachments like images etc. from at least non contacts. I think many/most other chat applications, by default, sanitize and/or format images and media on upload on the server by transcoding image data to prevent things like this and save bandwidth (e.g. Facebook/Meta appears to recompress images server side). However, there are obviously security and privacy considerations to doing this, and the client is not exactly something you want to trust to do this, so I can understand why they would be reluctant to implement something like this.

Perhaps this is one potential use of Treacherous (trusted) computing/remote attestation - the client runs a remotely attested signed binary code that will read an image file, encode the pixels as a jpg, and output a signed output that will only be accepted by the server if untampered.

Obviously, there would be issues with that approach as well, but it could potentially prevent the use of the iMessage network to send "crafted" media files.
> As a diehard “asker” I can’t help but see “guessing” as narcissistic. Why would you presume you know what I want?

Imagine that every time you said "no" to anything, it cost you $5.

If that were the case, would you probably find it rude if people made requests of you without much consideration - because every time you have to say "no" to such a request, $5 disappears from your bank account. I mean, you can still say "no", of course, but after a while all that money you are paying out starts to take a toll on you.

"Guess" culture doesn't exist in a vacuum. It exists in places where saying "no" to a request, even an onerous request that you have every right to refuse, exacts a social toll on the person refusing the request. Most people don't like awkwardness and don't like being perceived as rude or inhospitable, so if you live in a culture where refusing a request will lead to you being perceived that way, no matter how unreasonably, then you would probably resent being forced to saying no to requests. You might even end up saying "yes" to a few requests you would otherwise have said "no" to.

Guessers are not generally narcissistic, they are just trying to be considerate, trying to avoid placing a negative burden on your shoulders when they are the ones who want something.

Of course, if you are someone who doesn't have to pay $5 every time you say no to something, then all the incentives are misaligned and I can see why it's frustrating to deal with the guesser. But try to keep in mind that there are lots of people out there who really are paying that $5 every time.

I was raised in a hardcore guess culture, but now I have seen more of the world I have no problem asking for things directly so long as the person I am asking has no problem saying no. Without knowing that, I am still a guesser.
The main opposition is from the Hindu American Foundation, which has strong links to the Hindutva party governing India, (the BJP), which is affiliated to RSS, the extremist paramilitary Hindutva organization. You can probably understand why Hindu supremacist organizations would want to downplay or deny the negative effects of caste.
Image I/O has been mentioned elsewhere. Suspect it's code that's running in process from that library that's doing it.
This is not speculation much less crazy theorizing. Read the Missouri v Biden injunction. It’s crystal clear that FedGov infiltrated and basically zombified social media platforms to perform constitutionally prohibited censorship.
> Critics job is sometimes to tell you if you'll enjoy a movie. It's not the only job and it's not the only reason movies are made.

I believe I addressed this. I specifically mentioned that they have different metrics so you wouldn't expect it to fully lineup. It's the drastic disconnect that is the problem. If critics love a movie but literally no one else does, what are they seeing? Or, more directly, what is the point of me putting any validity into their words?
I think the reason that they focus on pure Python is because a big use case would be pure Python code bases that can be incrementally ported over to Mojo for better performance, without needing to totally abandon the Python language and ecosystem.
> just a wrapper

That phrase encompasses a huge amount of value. VS Code+PlatformIO is free but I would happily pay for it. I was already paying for an Arduino Visual Studio plugin (Visual Micros) before I learned about it.
Yeah, I think their "artsy fartsy" category needs to be split. If the reviewers are consistently positive while everyone else is negative, it tends to be in one of these categories:

* Overly artsy

* Overly political. Reviewers feel the need to give it a positive review because they agree with the message, while the audience will split because they're not as homogenous politically.

* Outraged fans. Reviewers aren't typically fans of a given franchise and so won't notice if it ruins something that would irritate a fan. The Last Jedi is in this category.

* Bribery.
Depending on the particular situation maybe vegas would work as well?

In particular, since Wireguard is UDP, using vegas over Wireguard seems to me like it should be good (based on a very limited understanding, though :/ ), it is just a question of how well it would work on the other side of the reverse proxy since I don't think it can be set per link?
Air pollution: Nearly everyone in Europe breathing bad air
Forget the complexity, just use integer version numbers.
> nothing stopping a web proxy operator from sniffing all user credentials passing through them, and modifying PHPRoxy to do this is trivial

That's why you go through seven proxies.
Semver is based on a lie. It assumes that you can define what is the proper behavior of a library. That's
not necessarily true, and can be subtlety false, and different depending on the use case. I can think on some situations where I trusted semantic versioning and it bited me when an update was made. I am not talking about new bug introductions. I assumed behavoir that the library owner assumed as not important.
I wonder if Apple has a mechanism for notifying people who were affected by the exploit after they update.
My point is a bit different though. It's not about culture wars or being anti or pro AI. It's about how silly it is to call one optimization function AI and another "not AI" and then make a whole curfuffel about bucking trends, when what you've done is actually something very similar. (Maybe very interesting in its own right and a good solution though, with its own desirable properties.. again, I'm not commenting on the paper itself, just this one off-hand comment in the blog.)

In my view calling a solution "neural" and "AI" because you are optimizing a stack of relus, and then turning around and solving the same (or almost the same) problem by optimizing a bunch of Gaussian model parameters on the same data, and then saying that is "not AI" and "at least it's not neural!" is just a very specious and unnecessary way to delineate things imho. They're just two solutions to the same problem, both data driven, both generating "models".. they have differences, just not differences that I think warranted such a comment in the blog, and moreover I thought it weird to attribute some kind of normative evaluation based on how you categorize the solution.
Very excited for this. Congrats Bun team. So cool that the runtime space is heating up :)
I find the subscription model leaves a bad taste in my mouth. I’d rather pay up front or pay to add it later. I also firmly believe in voting with you wallet and it doesnt matter what their marketing says, they are backtracking because it did not generate the income they hoped.
They don’t obviously fall under copyright, patent, or trademark—those are the only options for IP.

You can enter into general business contracts that govern how the parties make use of data. This happens all the time with all kinds of data sources: business listings, GIS, credit scores, etc.

If I copy of this kind of data, I might be breaking a contract and committing a tort, but I am not violating copyrights. If a third party gets the data without a contract in place and makes use of it, they are not violating copyright either; the liability falls on the contracted party that let the data get out.

But licenses of the kind proposed on models are inapplicable. Imagine how bizarre it would be if the phone book came with a license stating “you may only use the information for non-commercial purposes.” The phone book publisher would get laughed out of court and maybe even penalized for frivolous lawsuits.
Ruby on Rails creator removes TypeScript from Turbo framework, upsets community
Everyone is, because the grid is built out of smaller grids.

You and some number of your neighbors are connected to a transformer, some number of those transformers are connected to a larger transformer, and so on up the chain until you have an actual large grid.
I distinctly remember Internet old-timers complaining that after AOL connected its users to Usenet, the collective IQ in most newsgroups dropped.
Whatever, Tim Apple...
Fine-tune your SQLite database for production web app usage
> Set a limit, you get one password reset email per day/successful password reset.

I routinely see password reset emails get caught by greylisting. Most are released by the 2nd email but sometimes it takes more.
Here we go again... NSO Group has a long history of 0-click, 0-days against iMessage, and just a few months ago Kaspersky caught a different zero day iMessage exploit targeting their staff.

If Apple repeatedly fails at securing their devices from an attack vector that has been demonstrated over, and over, and over... no wonder China is banning government officials from using their devices.
I specifically said they use different metrics. The different score isn't the problem, it's the size of the schism.

40 million people not paid to review movies seem to hate this movie; but the 100 people who love it are both A) paid to watch it and B) seem to entirely fit the vast minority of viewers who like it.
Their FAQ says this:

Over time we expect to open-source core parts of Mojo, such as the standard library. However, Mojo is still young, so we will continue to incubate it within Modular until more of its internal architecture is fleshed out. We don’t have an established plan for open-sourcing yet.

I read this as:

"There are parts of Mojo that we are not planning to open source"

Which makes this a non-starter for me as well
Three Questions on Software Liability
Thank you both. I LOL'ed hard here.
wasn't able to get coffees from 3 different places, ended up at a starbucks
Both the Fedora and Asahi projects are stellar examples of community mindshare for Wayland in the FOSS ecosystem.
I suspect you and @matheusmoreira are making the same point. It's not a thought I've articulated before... Perhaps, as I've said in the sibling-post, saying they're "complicit in the corruption" is better...
You can enable iOS’s “lockdown mode” which disabled automatic download attachment, JavaScript JIT and other rather hard to secure features.
Why even bother posting that? This doesn't contribute to this post in any way
Adults love ice cream and "hate"* broccoli too, in general. They simply choose to eat one over the other based on external input.

You can't apply necessity to art. I don't have to eat some shitty art-film to survive.

* - Hate is probably an overloaded word anyways. I don't know many kids who genuinely "hate" broccoli, they just think eating broccoli means they won't get ice cream because they don't have rational thought processes and can't think/imagine beyond the next fifteen minutes. Adults can, and so the distaste is less extreme, because they can have ice cream on their cheat day. But obesity rates would show that nothing really changes, in how much they "like" things.
Small tool = less code to read through.

If you want to use that suspicious tool, you should at least take a glance at the source code.
I hate how much that mindset unironically speaks to me.
Found these two forks which are still accessible (and are supposedly up to date with the upstream repo (linked in the comment above) which is not accessible anymore):

https://github.com/bb33bb/getsymbol

https://github.com/clayne/win-getsymbol

here is the same link as in the comment above from one of the forks:

https://github.com/bb33bb/getsymbol/blob/main/GetSymbol/CMai...

the code fetches from `UPDATE_CHECK_URL`, which is hardcoded as:

https://dbgsymbol.com/version

which as of the time of this posting, returns:

"GetSymbol 2.0.3|https://dbgsymbol.com/downloads/2.0.3/GetSymbol.exe"

the GetSymbol.exe file (which is downloadable right now) being presumably the infected file being discussed..!
I'm not in the valley, so can't comment on that directly, however, I can comment that many VCs (US and abroad) have lost the "venture" part of VC, and that has hurt innovation.

For more than a decade, the focus was on building SaaS businesses that eked out minor efficiencies in the market.

The incentive was not to think big and try to build challenging things, the incentive was to do something simple, that would guarantee a return without much thought.

Don't hate the player, hate the game. (is that the saying?)

For the past 12 years, I've been in deep-tech, and though I am starting to see a change in attitude towards deep-tech companies, I feel like an inordinate amount of that focus is going to anyone who claims to be in AI.
Engine rather than a game, this video about UE4's particle system shows a lot https://www.youtube.com/watch?v=OXK2Xbd7D9w
CC-BY-SA-4.0, so you also can't claim original creation of it, you have to maintain an attribution to the original creator and you cannot change the license.
ChatGPT has infinite patience for the most basic questions, I'd probably start there. Yeah it makes things up and doesn't have personal experience, but you could probably get a decent answer (or at least a direction for further inquiry) after a few back and forth questions.

I thought its answer to the biking question was reasonable, give it a try.

Outside of that, you probably need some people that you know personally -- that should cut down on the unwanted pushback.
AFAIK, it's a general purpose language. I don't see any reason you wouldn't be able to use it for applications outside of ML.
WASM Analyzer
Introducing WASM Analyzer a tool for analyzing and debugging WebAssembly (WASM) components and modules. With support for the WebAssembly Registry (WARG)
Finally, I can use Mullvad.
Ruby does have a good reason to be oddball IMO. begin isn't always required. When inside a method, module, class, or do...end block definition (read: most of the time), you're able to use the rescue keyword solo. Anything raising an exception in the method above the rescue keyword will be caught.

It can also be used postfixed to a statement that might raise an exception.

Ruby is oddball here because it's subtly different.

def a_method
@value = dangerous_method_call rescue "default value in case of exception"
do_something_else @value
rescue
puts "an error, oh no"
end
check https://github.com/bb33bb/getsymbol and https://github.com/clayne/win-getsymbol, two up to date forks -- and my comment above https://news.ycombinator.com/item?id=37425311
I think you're right but I don't see any detailed information from The Citizen Lab. I expect a lot more information after some embargo timer runs out.

For context, here's another report from them outlining a similar vulnerability: https://citizenlab.ca/2021/08/bahrain-hacks-activists-with-n...
Getting to a 4-hour work week.

1. Start selling useless if not dangerous supplements online for a huge markup

2. Use that income to hire other people to do the work for you.

Bonus tip: hire people from poor countries, they are cheaper.

Totally ethical, totally fine.
Thus the brilliance of McSweeneys.
Also “transformative” doesn’t have its everyday meaning in this context:

“The Godfather” film is absolutely a transformative interpretation of Mario Puzo’s book and a fully distinct, valuable work of original art. Paramount still needed to pay Puzo for the right to base it on his words.
That's been my 'magic formula' for RT ratings as well :).
I dealt with closed source enterprise web servers back in the 90s. I am pretty sure Apache and nginx are safer. Maybe there are examples where that's not true, but my gut feeling is that "all eyes are shallow". Or something.
My solution is to wait for people in my network to bring up that they watched and liked something.
Clubhouse is rebranding itself as a better alternative for group texting
I LOVE the idea of a robot that draws people! I dont know if you would remember to send me an email if you ever make a video about this - sounds unreal.