skysight-inc/HackerNews huggingface dataset:
Yeah I'm not sure about redshift, but bigquery uses "autodetect" so something like

bq load --autodetect --source_format=CSV mydataset.mytable ./myfile.csv

And snowflake uses INFER_SCHEMA I believe you can do this

select * from table(
infer_schema(
location=>'@stage/my file.csv',
file_format=>'my_csv_format'
)
);

Although tbh I'm not sure if that's what you're looking for. You might enjoy looking at duckdb for stuff like this. My policy when starting data engineering was to bung everything into pandas dataframes, and now my policy is to try to avoid them at all costs because they're slow and memory hungry!
Without commenting on Google[1], I think this sort of thing is true in the short term but less true in the long term. I expect that, were Chrome to ban ad blockers, technical folks will start to teach non-technical folks in their orbit how to e.g. install Firefox to regain ad-blocking capability. I think it would take some number of years but there would be a pushback in the medium- to long-term.

1. Googler, opinion solely my own.
Anyone know if there is a LM Studio style tool for training models?
Playstation Days of Play 2024
I think it's absurd to say that only say 3% of crypto transactions are criminal, if the majority of other transactions are meaningless.

Surely what we actually care about is how many useful, legal, meaningful transactions there are.

For example if for every 1 legal transaction there is 3 illegal transactions and 96 speculative or maintenance transactions... it starts looking like this is predominantly for criminal uses even though only 3% of transactions are criminal.
Not the same, but we evaluated how good LLMs are at fixing code and just posted it on HN: https://news.ycombinator.com/item?id=40511689
Seems nice but some preliminary testing against GPT-4o shows it’s lacking a bit. It does a pretty good job for easy questions though
America's Military Is Not Prepared for War – Or Peace
...and if they went too fast the hand smudges and wrapping would make previous content indecipherable when they rolled it back :)
If your goal is to waste people's time, cause them to question their sanity, and guarantee that they're way too pissed off when they finally figure out what happened that instead of teaching others about how important it is too use HTTPS from the start, they talk about how awful your API is and how much they hate your company for a terrible design, then yes this sounds like a good plan.
> That’s not to say that the benefits of RTO always outweigh the costs, but I find the trope that RTO is just some pointy-haired boss whim to be silly.

Exactly. I prefer to WFH like everybody else, but I accept that I am less valuable to my employer when I do and expect to negotiate accordingly.

For people who refuse to believe this, I think you can just link to the history of MIT Building 20 and pretty much drop the mic.

https://en.wikipedia.org/wiki/Building_20#:~:text=In%201998%....
In one of the US's hottest deserts, utilities push gas rather than solar
I think this was more comprehensively described by The (Eight) Laws of Software Evolution: https://en.wikipedia.org/wiki/Lehman%27s_laws_of_software_ev...

This subject always reminds me of something someone said, possibly Professor Alain April, "software is the only system where maintenance tends to degrade it."
Rather like Afghanistan, you can prop up a government that has no real legitimacy outside the capital for as long as you're prepared to pay for it, but then it collapses.

I do not fully understand the backstory, but the Vienamese seem to have done OK out of the "Communist" victory. It's a very different place from North Korea.

Alternate counterfactual: is there a route through history where https://en.wikipedia.org/wiki/Haiphong_incident does not take place and a peaceful, unified Vietnam exists from the end of WW2 onwards?
i've been noticing that there's a divergence in philosophy between Llama style LLMs (Mistral are Meta alums so I'm counting them in tehre) and OpenAI/GPT style LLMs when it comes to code.

GPT3.5+ prioritized code very heavily - there's no CodeGPT, its just GPT4, and every version is better than the last.

Whereas the Llama/Mistral models are now shipping the general language model first, then adding CodeLlama/Codestral with additional pretraining (it seems like we don't know how much more tokens are on this one, but CodeLLama was 500B-1T extra tokens of code).

Zuck has mentioned recently that he doesnt see coding ability as important for his usecases, whereas obviously OpenAI is betting heavily on code as a way to improve LLM reasoning for AGI.
Simon has been working on this technology for a while, and is fairly prolific about writing about it. It's more likely that it didn't "take long" for Simon to figure it out, but more that it was come to be realized that others had misconceptions about how it worked, thus the usefulness of posting about it presented itself.

Things usually aren't black and white, unless of course they are bits...
Ontario (Ottawa & Toronto), and I think back in the day in Manitoba.

Note my update, it may be propane rather than natural gas though
School choice, as defined by Florida, is too helpful to upper-middle-class and rich children. Of course, if presented with the option to take your child's funding and add more $$ for a better experience and outcomes, any parent who had the means would. This is already the system for universities.

These schools are then predominately attended by upper middle class and rich children, and that cohort has enduring benefits socially and economically.

School choice should require that every dollar spent to advantage your child over others is taxed at 2 dollars and that money offers opportunities to underprivileged children.

I don't think any serious person can deny that public schools aren't performing at high standards internationally, but let's not have the solution be yet another system that advantages the rich.
> 1) the compute needed to get GPT4 performance will decrease. 2) the compute on consumer GPUs will increase.

I’m assuming we’re just talking inference here…

Sure compute abilities for consumers will increase but the original comment had a fixed GPU - the 4090. I can already eke out LLama3:8b on my MacBook Air, and Apple will sell you a laptop capable of running the full sized LLama.

There is a direct correlation between parameters and “knowledge” for an LM. There’s some open questions as to density (LLaMa3 specifically challenged previous assumptions) but it seems implausible to fit an equivalent model as GPT4 into 24gb vram. Just like compression, you can’t shrink forever.

GPT-4 and GPT-2 are pretty similar architecturally (I assume). So if abilities don’t matter, we can already run GPT-2 so we’re basically there for 4.
The OP's article was careful to make this distinction, and I think it's very interesting (as well as being the crucial point of the article). Cars are now more reliable and last longer, but when they do develop a problem, it's less economically viable to repair them.
"People of affluence" what does this mean?
Prisoner's dilemma and/or social pressure when million in profit share units hang in the balance. Joining MS was a way to stop their compensation being at risk by being stuck on a sinking ship
Very impressed with it based on a short live chat, feels insanely fast considering its capability.

chat.mistral.ai
The rule of thumb is roughly 44gb, as most models are trained in bf16, and require 16 bits per parameter, so 2 bytes. You need a bit more for activations, so maybe 50GB?

you need enough RAM and HBM (GPU RAM) so it’s a constraint on both.
I'm not sure I buy the comparison to Internet privacy. The comparison to cell phone tracking elsewhere in the comments is better.

It's bad enough that the government has relatively trivial access to cellphone tracking data, but if it was publicly available, that would be pretty disastrous on a lot of fronts.

Yes, this is a law that only protects rich people, but it's also a problem that only affects rich people, and I'm pretty comfortable saying that it is a problem.

As long as not too much money or effort is being diverted to this (and therefore away from the hundreds of more important problems), I just really can't get that worked up over it.
Considering tech billionaires got rich by destroying our privacy, why do only they deserve a law protecting their privacy?
That's a good point: I didn't consider that they might have additional non-transformer models running in the ChatGPT layer that aren't exposed via their API models.

I think that's quite unlikely, given the recent launch of their "memory" feature which wouldn't be necessary if they had a more sophisticated mechanism for achieving the same thing.

As always, the total lack of transparency really hurts them here.
Dive into the future of advertising with #PencilAI! Discover how generative AI is transforming creativity and driving growth in media. Stay ahead of the curve with #BrandTech and revolutionize your strategy. #AIAdvertising #FutureIsNow #TechTrends #CreativeRevolution
the carbon shaming of celebrities seems to tap into a sort of “sneer at the rich” morality that is very attractive to the masses and thus is probably effective at motivating people to pass things like carbon taxes
Copilot primarily uses GPT-3.5, which is outclassed by Llama3-70B. And this model claims to be slightly better than Llama3-70B.

Edit: For those who don't believe me, https://github.com/microsoft/vscode-copilot-release/issues/6.... Gpt-4 for chat, 3.5 for code.
> The only real question is WHEN the 11% return will overtake the 4% return. The interest on the 4%-returning loan is a factor, but it's secondary.

If we ignore the interest rate on the loan and simply assume stock market always makes 11% and real estate market always makes 4%, then the situation becomes really simple and is in favor of real estate investing.

Suppose a person has $20k to invest and they are considering putting it as down payment on a house, or investing in the stock market. (Let's ignore future cash flows and how those are invested, just consider the initial investment of $20k.)

Stock market option: $20k with no leverage -> 11% ROI on a $20k investment

Real estate option: $20k of your own money + $80k of the bank's money -> 4% ROI on $100k investment (counting both your money and the loan) -> 20% ROI on $20k investment (counting only your own money)

20% is better than 11%, so if you could get a zero interest loan, then the real estate investment would be much better.

Now, if we assume the interest rate is not 0%, but is instead 4% (same as our expected return), then of course the situation looks bleak.

So the interest on the loan is not a "secondary" factor. It's the most important factor.

I think the main point grandparent in this thread was trying to say that it's very easy to get cheap leverage on a mortgage, and basically impossible to get cheap leverage on stock market investments, and when you put the math on the back of the napkin like this, it becomes clear that the access to leverage can make real estate investing more appealing than stock market investing.
It would block requests to OCSP responders, for one.
Do you know of any chat tools that are publicly documented as using this technique?
That really depends on what you mean by "native ads"; if you mean "blog posts that appear legitimate but push a product" then maybe not (although I wouldn't totally rule it out with LLMs), but if you just mean that the ads are inline I have to disagree since ex. SponsorBlock already exists.
The only way this will happen is if the shareholders realize that they can save money, and generate even more profit for them. Perhaps we need to demonstrate this experimentally and compare the results to CEO's in similar industries. Then watch as it is immediately and resoundingly banned through legislation and rhetoric.
The problem with this theory is that the $50 boot manufacturers sell out to private equity when the founder wants to retire and then the PE firm jacks up the price to $75 and drops the quality below the $10 cardboard boots... so you're out even more money to have wet feet.
Justification before decision still works out better in practice, though, because of chain of thought [1]. You'll tend to get more accurate and better-justified decisions.

With decision before justification, you tend to have a greater risk of the output being a wrong decision followed by convincing BS justifying it.

(edit: Another way you could think of it is, LLMs still can't violate causality. Attention heads' ability to look in both directions with respect to a particular token's position in the sequence does not enable them to see into the future and observe tokens that don't exist yet.)

1: https://arxiv.org/abs/2201.11903
Show HN: I made a clean NSFW AI Chatbot with GPT 4 that send pictures
Hello HN, I always wondered why NSFW AI chatbot websites look all the same : darkish, unfriendly and mostly hentai content. Then it's not even real conversation but kind of twisted stories with descriptions and subtext... So I made a clean website that offers proper NSFW conversations (iMessage like) with classic characters having real (kinky) stories with pictures.

I know it's quite unusual on HN, so I hope you'll find it useful and feel free to comment!

Spread love <3

Greg
This is just one of many misconceptions about LLMs. If you are at all involved in trying to build/deploy a product based around LLMs, your head will explode as you talk to users and realize the vast chasm between how folks who understand them think about and use them, and folks who don't understand them. It's frustrating on both sides.

It's quite unclear if we'll ever hit the point where (like, a car for example) someone who has no idea how it works gets as much out of it as someone who does.
> I'm pretty comfortable saying that it is a problem.

On what evidence?
Some of those people of affluence hold opinions like this:

> “If you have something that you don’t want anyone to know, maybe you shouldn’t be doing it in the first place.”

Moreover the companies many of them operate are more than happy to stalk people for ad dollars. So... I'm not sure why we're going out of our way to protect them specifically.
Ask for a report from a market analyst.

Out of curiosity, though, what language would you imagine is now chosen more frequently than Java for important server-side applications? (you can test your guess against some publicly-available jobs data such as https://www.devjobsscanner.com/blog/top-8-most-demanded-prog...)
We have seen these a thousand times. I say bring it on. The pendulum has swung solidly into the hands of users. We have so many privacy tools to counter state surveillance these days. Any country openly conducting mass surveillance will soon see the target population wrap itself in VPNs and encrypted services. Remember when ISPs began throttling torrents? Everyone then flicked the switch and torrent traffic become encrypted. Remember the London riots, what happened to RIM shortly afterwards? Remember Lavabit? Go ahead and tap my SMS or whatsapp text messages. That's the push I need to switch the last of my friends over to Signal.
I've done that myself and have consumed many others who have done it, and I don't think it's better. Much better to get a response that tells you to use https for the API. (for browser also a redirect is a must for UX, though our context here is API)
32.8% of global users use an ad blocker. (33% of Americans.) [1]

Chrome's market share is about 65% [2]. If their recent manifest changes eventually break ad blocking (which seems to be the goal), it'll lose a bunch of market share (I guess they're optimizing for short-term profit).

[1] https://backlinko.com/ad-blockers-users
[2] https://gs.statcounter.com/browser-market-share
I hope the parent comment had a heavy dose of sarcasm seeing as his net worth is $200B and Tesla is also doing well.

He has certainly made some bizarre choices running Twitter though.
But that's the thing, I'm in the similar position to others in the chain - last week, an audiologist said my hearing was tremendously good. But if there's noise around me, I cannot process what people are saying.

I'm not sure what you mean by "only if you've learned some helplessness." I'm not a complete idiot, I can generally guess what someone is saying based on context, but if I'm having a conversation with Group A in a loud environment, and someone from group B turns to me and says something, I don't have much context as to what they're saying.

(Also, a PSA: if someone who didn't hear you says, "what", or "can you say that again?", don't just repeat the last three words you said. Please repeat the entire sentence. I know that usually, the last few words provide enough context to reconstruct the sentence, but if you just tell me "this Sunday?" it's usually not enough, you have to just say, "Are you still planning on reconfiguring the encambulator this Sunday?")
I'm so happy now LLMs are democratising access to programming, especially open models like what Meta with Llama and Mistral is doing with Codestral are doing.

The abundance of programming is going to allow almost everyone to become a great programmer.

This is so exciting to see and each day programming is becoming a solved problem so we can focus on other things.
Yes! Enjoyable and I have learned a lot about how car engines work and are built watching it. And how some companies (cough - Audi - cough) intentionally overengineer their designs so much to boost service and repair cash flows.
>Zuck has mentioned recently

That's a really surprising thing to hear, where did you see that? The only quote I've seen is this one:

>“One hypothesis was that coding isn’t that important because it’s not like a lot of people are going to ask coding questions in WhatsApp,” he says. “It turns out that coding is actually really important structurally for having the LLMs be able to understand the rigor and hierarchical structure of knowledge, and just generally have more of an intuitive sense of logic.”

https://www.theverge.com/2024/1/18/24042354/mark-zuckerberg-...
A Unifying Principle for the Functional Organization of Visual Cortex
The rule is against doxxing and harassment here. That doesn't mean we can't support or advocate for their use elsewhere.

Not that I am trying to do that per se. But just pointing out that HN doesn't & can't really demand ideological commitment to not using specific conflict tactics broadly.
Oh, OK.

You need to replace calls to syscall.Mmap with windows.VirtualAlloc [1], syscall.Mprotect with windows.VirtualProtect, etc.

You don't even need to change the ASM preamble.

[1]: https://pkg.go.dev/golang.org/x/sys/windows#VirtualAlloc
That's the answer.

Windows Internals is a really good source for deep understanding of the OS.
In Hindi and some other Indian languages, it is common to drop the last short “a” of a Sanskrit word, hence Ram for Rama, Vikram for Vikrama, etc.
I live in Phoenix and now take Waymo regularly, and it seems like we're close to a world in which most people take self-driving cars most of the time, crash rates plummet, and these kinds of articles come to resemble articles from 1910 about horse-related problems.

Humans suck at driving: https://jakeseliger.com/2019/12/16/maybe-cars-are-just-reall...
> “Someone who is already quite advanced in their career and is already fairly self-motivated may not need a human boss anymore,” said Phoebe V. Moore, professor of management and the futures of work at the University of Essex Business School. “In that case, software for self-management can even enhance worker agency.”

This idea is as old as the hills. I guess you could call it the "first, we kill all the [middle] managers" approach. It's popular with people who don't really understand how managers help groups of people work together efficiently.
Every day in the United States, a large number of cars are being produced. Most of these cars never get sold to customers because people just can’t afford them.

Oh yes, that makes perfect sense, every day they make 100 cars and then scrap more than 50 of them.

The car manufacturing industry can’t stop producing new automobiles because they would have to close their factories and lay off thousands of their workers.

Right, layoffs, that never happens.
The single best thing you can do to improve internet browsing experience is to turn off JavaScript.
best place is the code.golf wiki: https://code.golf/wiki/langs/javascript. They also have tips for other languages.
I know about at least one big world wide corp that use LLM for checking CVs, I'm not sure if something like that would actually change result (mostly because this is multi prompt chain)
but it's definitely used/considered by many companies

you cannot use chatgpt, but you can use azure openai API (with is basically the same thing, but because it's hosted solution, its allowed to be used)
I'd argue that's how all modern "cloud" services are, some cool tech that Microsoft purchased and then integrated with duct tape and chewing gum.

SharePoint, Exchange Online, Azure, it's all bound together by a string with APIs that can barely speak the same language.
People often correct bad generation and I think such feedback is valuable. eg "Training Language Models with Language Feedback at Scale" https://arxiv.org/abs/2303.16755
A view on private equity and public services: this trend needs reversing
Phone cameras can take in more light than the human eye
I know that opponents of the current gov are enjoying this line recently, but our government is so far from totalitarianism that this seems silly to me.

The real problem is oligopoly, not fascism or anything like that.

The government puts most of its effort into protecting friendly companies and industries from competition and even funneling taxpayer money to them.

In the case of Bell & Rogers this is billions of $ a year.
The codes are simply not sufficient. The codes simply dictate the minimum required to prevent significant loss of human life and property, but just as there is a vast gulf between "people dying and houses collapsing" and Things Are Up To Code™ there is too a vast gradient between the latter and Things Just Work™

When I first bought my house I tried to put in a warranty claim due to *MAJOR* deflection of subfloor in the kitchen and suspected water damage related to the installation of some plumbing. They refused to do anything unless I got the state involved; Literally they gave me the contact number for the state department responsible for ensuring everything was Good Enough™

Months later, nothing was fixed because according to the State as long as I can't stick my foot through a hole in the ground and get hurt there is nothing wrong. Never mind the fact that there is a slow water leak and the subfloor and joists are undergoing structural deterioration before I even moved in.

Had I known the headache this would cause, and known I could have taken other legal recourse I would have lawyered up at this point, but I was a young 24 year old with a 2 year old and another child on the way. I didn't know what to expect, I trusted the State, I trusted the builder, I trusted the realtors who all told me it was Ok™.

Up to code means it's safe to inhabit, not that you'd *want* to inhabit.
And yet, you need a drivers license to operate a car. Computers, AI and other technology everyone is allowed to use, even without basic understanding of how stuff works.
You can do this with a sophisticated RAG system.
The cultural disconnect is to me the smiley in that context indicated you didn't believe there was actually any problem and assumed there would be no valid answer to the question, and the question was insincere.

Very cynical and probably at least partly the result of projection, and I do now believe your sincerity, so I am only explaining equally sincerely now, not criticizing.
I play drums for fun. The vocalists usually wear earplugs too. Because they’ll get hearing damage if they don’t. Instruments can be loud. Look up “Earasers” if interested, they’re the ones I use. They work in a way that music sounds reasonable, but still protects your ears.