skysight-inc/HackerNews huggingface dataset:
i'm talking about the strictly among the biggest companies
Insanity. Absolutely. Maybe.

Clearly there's a need for some kind of bad-url blocker. You don't want compromised accounts (or clueless people) sharing nefarious links to trusted friends.

And clearly blocking distrowatch etc is bizarre overreach. And probably not intended behaviour -- it just makes no sense.

The web exists just fine. Using Facebook as a front end to the web is a terrible idea though.
I know you're only half serious, but ...

The problem isn't when one uncle is doing this. The problem is when the bulk of the content you see on FB is as crazy as this.

I mean, if you like purchasing the National Enquirer and flipping through it, then by all means, this is for you.
JigsawStacks Prompt Engine's Input Limit Increased from 30k to 500k Characters
We're excited to announce JigsawStack's Prompt Engine total input limit has been increased from 30,000 characters to a 500,000 characters!

No matter how you use Prompt Engine—be it for research, automation, or large-scale integrations—this update brings greater flexibility and power to create transformative AI solutions.

Learn more about the update and how it can elevate your projects here: https://jigsawstack.com/blog/prompt-engine-now-supports-up-to-500000-characters
Another great interview dug up from 2020 but translated today.

https://www.pekingnology.com/p/ceo-of-deepseeks-parent-high-...

Interesting tidbit:

>So far, there are perhaps only two first-person accounts from DeepSeek, in two separate interviews given by the company’s founder.

I knew DeepSeek was lowkey but I didn't expect this much stealthmode. They were likely off CCP boomer radar until last week when Liang met with PRC premiere after R1 exploded. Finance quants turned AI powerhouse validates CCP strategy to crush finance compensation to redirect top talent to strategic soft/hardware. I assume they're going to get a lot more state support now, especially if US decides to entity list DeepSeek for succeeding / making the market bleed.
I agree. In my opinion, if you can keep the experience of Bazel limited to build targets, there is a low barrier to entry even if it is tedious. Major issues show up with Bazel once you start having to write rules, tool chains, or if your workspace file talks to the Internet.

I think you can fix these issues by using a package manager around Bazel. Conda is my preferred choice because it is in the top tier for adoption, cross platform support, and supported more locked down use cases like going through mirrors, not having root, not controlling file paths, etc. What Bazel gets from this is a generic solution for package management with better version solving for build rules, source dependencies and binary dependencies. By sourcing binary deps from conda forge, you get a midpoint between deep investment into Bazel and binaries with unknown provenance which allows you to incrementally move to source as appropriate.

Additional notes: some requirements limit utility and approach being partial support of a platform. If you require root on Linux, wsl on Windows, have frequent compilation breakage on darwin, or neglect Windows file paths, your cross platform support is partial in my book.

Use of Java for Bazel and Python for conda might be regrettable, but not bad enough to warrant moving down the list of adoption and in my experience there is vastly more Bazel out there than Buck or other competitors. Similarly, you want to see some adoption from Haskell, Rust, Julia, Golang, Python, C++, etc.

JavaScript is thorny. You really don't want to have to deal with multiple versions of the same library with compiled languages, but you have to with JavaScript. I haven't seen too much demand for JavaScript bindings to C++ wrappers around a Rust core that uses C core libraries, but I do see that for Python bindings.
> Why couldn't Windows just copy whatever Linux did?

They kinda did: https://en.wikipedia.org/wiki/Azure_Linux
I don't think GP was talking about themselves being a junior using LLMs, at least my interpretation was that devs should learn how to leverage misguided junior, and LLMs are more-or-less on the level of a misguided junior.

Which I completely agree, I use LLMs for the cases where I do know what I'm trying to do, I just can't remember some exact detail that would require reading documentation. It's much quicker to leverage a LLM rather than going on a wild goose chase of the piece of information I know exists.

Also it's a pretty good tool to scaffold the boring stuff, asking a LLM "generate test code for X asserting A, B, and C" and editing it to be a proper test frees up mental space for more important stuff.

I wouldn't trust a LLM to generate any kind of business logic-heavy code, instead I use it as a quite smart template/scaffold generator.
The idea is nice. The implementation is a bit gaudy design-wise (subjective, granted) and flakey on the hardware side, with the HR sensor accuracy being the main issue.
> speech standards should be determined by public opinion and not by reason, evidence and a scientific mindset.

Yes this is largely a debate between a top-down technocratic worldview vs democratic/meritocratic one. The point is FB is still very much on the former highly centralized expert-defined guideline/automated system side while only making small moves in the other direction with community notes. Maybe they'll keep going in that direction but what they say vs do is an important distinction.
>- Android devices go to Pixel Watch,
What's the real key to a fulfilling life?
Is it? Training is only done once, inference requires GPUs to scale, especially for a 685B model. And now, there’s an open source o1 equivalent model that companies can run locally, which means that there’s a much bigger market for underutilized on-prem GPUs.
It's great to see them coming back! I adored my Pebble(s). 2 fun stories:

1. Pebble supported 3rd party watch faces based on a file. There was a great little site that let you use a visual UI to build the file and, if done from your phone, upload it right to the watch. Once, when out at midnight beer launch, I made a custom face for the beer and won a little keychain from the brewery. My Apple watch could never.

2. Once time in 2014, I ran into some Pebble engineers at an ice cream shop in Palo Alto, they spotted my watch, they bought my scoop! Fun, weird little Silicon Valley moment.
third party apps (particularly stuff like messaging, banking and government services) only supporting the main two operating systems is a big barrier to a new one getting any traction.
> We're not expecting a co-pilot

Microsoft’s offering is literally called “copilot”. That is exactly what they’re marketing it as.
I had to look for a job both in 2023 and last year. For me it was both a network and specialized skills.

Specialized skills for me was cloud + app dev consulting and working at AWS (ProServe) and even more specialized was that I was a major contributor on a popular official open source “AWS Solution” in it niche and I had my own published open source solutions on AWS’s official GitHub site.

That led to two interviews and one offer within three weeks.

My network led to offers where a former manager submitted me to a position at the company that had acquired the company we worked for as a “staff architect” over the technical direction of all of their acquisitions. They gave me an offer.

My network also got me an offer from a former coworker who was a director of a F500 non tech company. He was going to make a position for me to be over the cloud architecture and migration strategies. He trusted me and he had just started working there.

Last year, my current job just fell in my lap, the internal recruiter reached out to out to me and that led to an offer.

I also had another former CTO throw a short term contract my way to tide me over.

But on the other hand, my plan B applications as a standard enterprise CRUD developer working remotely led to nothing.
I dont know either.. but I can say that in some extractive industry, for example timber and wood products.. in a commodity market that is an old, established market.. profit and economic expansion that occurs in other aspects of the economy do not reach the economics of the timber. In other words, newly minted millionaires by stock offering and corporate employment in the cell phone industry, do not move the needle on the core parts of the old, commodity timber products. Public news and government statements act as if there is "one economy" that is doing well or not doing well, but this is superficial .. trade goods transacted in the US dollar are sort of linked; trade of goods and services under a unified set of laws like USA interstate commerce laws are sort of linked.. but in Truth, there are winners and losers each year, and that extends to whole market segments, too..

This is a long introductory statement to say that.. just because landlords in Santa Clara County California are driving Porches, or ex-FAANG digital nomads count their money in units of $100k, does not at all mean that big, stable companies and their owners and investors, are seeing the growth that others nearby are seeing.. SO .. how to "catch up" when you are an big brand food company? raise prices.. "greedflation" .. but its not just greed, its a distribution system of profits.. this is an old situation. Stock markets are supposed to ameliorate this friction but not perfectly.. young Turks want Lambos, not fairness.

There have been sarcastic articles about medical doctors that are envious of stock brokers because the doctors cant buy the biggest houses anymore.. but it also includes a local Mexican restaurant going broke on labor and food costs, while Lambos drive by on their way to the airport.. source: personal musing
The intriguing phenomenon helping planes slingshot across Atlantic at 800 MPH
Clippy's reincarnation seems a bit... extreme.
Not instantly. You’d give the human junior dev the benefit of the doubt at first. But when it becomes clear that the junior dev is faking competence all the time (that might take longer than the four days in TFA — yes I know it’s not exactly comparable, just saying) and won’t stop with that and start being honest instead, you’d eventually let them go, because that’s no way to work with someone.
H5N9

so confusing I thought bird flu was H1N1, but apparently not.

Influenza A viruses (IAVs) are divided into subtypes based on the antigenicity of their membrane-bound surface glycoproteins, hemagglutinin (HA) and neuraminidase (NA).

Sixteen distinct HA subtypes (H1-H16) and 9 NA subtypes (N1-N9) have been identified that circulate in wild bird populations

IAVs are further divided into highly pathogenic avian influenza (HPAI) and low pathogenic avian influenza (LPAI), which refers to their ability to cause disease in domestic poultry

poultry in this case = a duck

Quack quack
Selling 100 chips for $1 profit is less profitable than selling 20 chips for $10 profit.
Just a few days ago the Wall Street Journal ran an interview with OpenAI's Chief Product Officer (https://www.wsj.com/livecoverage/stock-market-today-dow-sp50...), the headline was:

> OpenAI Hails $500 Billion Stargate Plan: 'More Compute Leads to Better Models'

The cynic in me is much more likely to see this as western companies giving up on innovation in favor of grift, and their competition in the east exposing the move for what it is.

This is why competition is good. Let's make this about us (those who would do this in the open) and them (those who wouldn't) and not us (US) and them (China).
https://archive.ph/oGsyy
SoftBank is very used to regretting decisions. Very used to.
I believe you that it had to do with the selloff, but I believe that efficiency improvements are good news for NVIDIA: each card just got 20x more useful
I have a Withings watch which has about 30 days battery life. Granted the display is tiny but I love that it looks like a normal watch and gets out of the way.

I'd buy a Pebble if it hit 14d+ battery life with health tracking features.
often it's something you casually overlook, some minor implementation detail that you didn't give much thought to that ends up being a huge mess later on, IME
If people are seeing the only way to be a "standout contributor" being about putting in more than 40 hours a week, we may have found the disconnect.

I don't work more than 40 hours a week, but when I slack off I just do the work put in front of me. Rather than hours, it's about energy.

If companies want more than 40 hours a week, we can negotiate overtime. But I put extra energy in during the work week not because I think it makes me extra money or protects me from layoffs. I do it just because I think it is better.
Meaningful design decisions flow from clear intent, not from data
It’s been the industry standard for like 20 years
I'm still trying to understand if these NAND chips are proprietary and if so where vendors are getting them.
Then why do we have powerful CPUs instead of a bunch of specialized hardware? It's because the value of a CPU is in its versatility and ubiquity. If a CPU can do a thing good enough, then most programs/computers will do that thing on a CPU instead of having the increased complexity and cost of a GPU, even if a GPU would do it better.
Unfortunately all the heavy isotopes of gold are unstable and will decay in a few months.
A friend just sent me a screenshot where he asks DeepSeek if it has an app for Mac and it replies that they have a ChatGPT app from OpenAI, lol.

I 100% believe they distilled GPT-4, hence the low "training" cost.
In my experience, a LLM decided to not know type alignment rules in C and confidently trotted out the wrong answer. It left a horrible taste in my mouth for the one time I decided to look at using a LLM for anything and it keeps leaving me wondering if I'd end up more time bashing the LLM into working than just working out the answer myself and learning the underlying reasoning why.

It was so wrong that I wonder what version of the C standard it was even hallucinating.
To me, this seems like we are back again in 1953 and a company just announced they are now capable of building one of IBM's 5 computers for 10% of the price.

I really don't understand the rationale of "We can now train GPT 4o for 10% the price, so that will bring demand for GPUs down.". If I can train GPT 4o for 10% the price, and I have a budget of 1B USD, that means I'm now going to use the same budget and train my model for 10x as long (or 10x bigger).

At the same time, a lot of small players that couldn't properly train a model before, because the starting point was simply out of their reach, will now be able to purchase equipment that's capable of something of note, and they will buy even more GPUs.

P.S. Yes, I know that the original quote "I think there is a world market for maybe five computers", was taken out of context.

P.S.S. In this rationale, I'm also operating under the assumption that Deepseek numbers are real. Which, given the track record of Chinese companies, is probably not true.
> the Chinese

Daya Guo, Dejian Yang, Haowei Zhang, et.al., quant researchers at High Flyer, a hedge fund based in China, open-sourced their work on a chain-of-thought reasoning model, based on Qwen and LLama (open source LLMs).

It would be somewhat bizarre to describe Meta's open sourcing of LLama as "the Americans gifting a model", despite Meta having a corporate headquarters in the United States.
Thank you for actually spelling porn. This whole thing around altering spelling to avoid blocking which I presume comes out of other apps has gotten to be quite annoying.
Show me the software you're charging for and I will unilaterally decide it's built on prior work and re-sell it.
Not a true verification but I have tried the Deepseek R1 7b model running locally, it runs on my 6gb laptop GPU and the results are impressive.

Its obviously constrained by this hardware and this model size as it does some strange things sometimes and it is slow (30 secs to respond) but I've got it to do some impressive things that GPT4 struggles with or fails on.

Also of note I asked it about Taiwan and it parroted the official CCP line about Taiwan being part of China, without even the usual delay while it generated the result.
each card is not 20x more useful lol. there's no evidence yet that the deepseek architecture would even yield a substantially (20x) more performant model with more compute.

if there's evidence to the contrary I'd love to see. in any case I don't think a h800 is even 20x better than a h100 anyway, so the 20x increase has to be wrong.
smart watch category has plenty of players. google, samsung, garmin, Whoop, Withings, Oura are all doing well.

It's funny with capitalism how for every purported failure there are 10 successes.
Why don't you launch now together?

It will clarify the business value and you still don't have an issue
>The cost of BCG is US$2–3 (£1.12–1.70) per dose (from https://pmc.ncbi.nlm.nih.gov/articles/PMC2083037/)

Even for poor countries it's not much. In the UK when I had it they sent a nurse round to the school and all the kids lined up and they did like one a minute. Free to us lot of course on the NHS.

I think it was quite nasty and leaves a scar though.
This is what open source was made for.

I once had a coworker like that who hadn't taken a vacation in two years. I told him that vacation time was how the company funded his open source work, and suddenly he took his full five weeks off each year to recharge by coding different code.
> In my general experience that doesn't happen very often.

Pumping up prices is exactly what large corporations seek to do once they have a large market share. If possible, lowering costs at the same time. Matt Stoller has an article explaining how Walmart did this from the 70s through to this century: https://www.thebignewsletter.com/p/walmart-americas-food-gov...
> Consider how this plays out in Silicon Valley, where the "move fast and break things" mentality has created a leadership culture that celebrates disruption over sustainability, dominance over collaboration.

That’s how the article phrased it. I’m not certain if I agree or not, but I’m not ready to either accept or dismiss it.
Well seems Deepseek still used CUDA at least
Thanks so much for mentioning this. His name carries a lot of weight for me as well.
The feature I use the most on my smartwatch is paying.

So if they can bring contactless payments to their new Pebble they have my attention, otherwise it's useless to me.
At the cost of looking very dull and washed out.
To be clear, the people who believe speech standards should be determined by public opinion are as incorrect as, say, flat earthers.

I don't have a huge problem with community notes per se. I do have a huge problem with blatantly unequal standards just because large parts of the public have morally rotten views.
Think about all the time saved not having to do sudo or su.
>medium range (e.g. DeepSeek R1x) AI will probably be good enough for most business and user needs

Except R1 isn't "medium range" - it's fully competitive with SOTA models at a fraction of the cost. Unless you need multimodal capability or you're desperate to wring out the last percentage point of performance, there's no good reason to use a more expensive model.

The real hidden message is that we're still barely getting started. DeepSeek have completely exploded the idea that LLM architecture has peaked and we're just in an arms race for more compute. 100 engineers found an order of magnitude's worth of low-hanging fruit. What will other companies will be able to do with a similar architectural approach? What other straightforward optimisations are just waiting to be implemented? What will R2 look like if they decide to spend $60m or $600m on a training run?
Go ahead and test it out. Have llama or chatgpt trash trump and have deepseek do it. Have them trash xi and his crew as well.

My political stance is immaterial. I’d like an Llm that doesn’t bring political baggage with it. It it can’t accomplish that minor thing it’s not worth trusting.
Just a comment from the first couple of paras there:

> Wordpress.org (WP.org) – Open source software, partially created & owned by Mullenweg

I feel that's wrong?

WordPress is an open source software project and the most popular CMS on the web.

(and it's probably worth mentioning that Mullenweg (and others) originally forked it from b2/cafepress, especially in the context of Mullenweg claiming WPEngine should be "giving back to the Word>Press community" in exactly the way he didn't do for the b2/cafepress community.)

wordpress.org is the main repository of the WordPress code and the home for a huge portion all the community contributed themes and plugins. It is hard coded into the WordPress core source code making it difficult to avoind or replace for most users. The website itself is exclusively and personally owned by Mullenweg, not the WordPress Foundation.

(And it might be worth explaining that he can and has banned people from logging in based on his personal drama, which removes the ability for theme/plugin authors to provide update and security fixes. Mullenweg has also "stolen" plugin urls, for example replacing WPEngine's wildly popular Advance Custom Fields plugin with his own "Secure Custom Fields".)
Welcome to every company that pays at top of band…
Paraphrasing this great quote I got from a vsauce video:

"A technology is neither evil nor good, it is a key which unlocks 2 doors. One leads to heaven, and one to hell. It's up to the humans to decide which one they pick."
Do you not have coworkers?

There are more people involved in software creation than just you and your manager.
Chinese tech companies are also investing into AI. DeepSeek team isn't the only one (and probably the least funded one?) within mainland. This is mostly a challenge to the "American AI is yeas ahead" illusion, and a show that maybe investing only in American companies isn't the smartest method, as others might beat them in their own game.
Was reading a news article the other day that described wget as a "hacking tool" and about rolled my eyes into the back of my head.
Can you though? Every time airtags come up here someone is like "you can get GPS trackers already! they're cheap!" but I actually looked and actual GPS trackers that don't require a subscription or have various other flaws seem to be very difficult to find.

If there's a GPS tracker that uses an eSIM and isn't sketchy af and has decent battery life and isn't £100 let me know! I would love that for my bikes.
Because DeepSeek demonstrates that loads of compute isn't necessary for high-performing models, and so we won't need as much and as powerful of hardware as was previously thought, which is what Nivida's valuation is based on?
Nvida has a P/E of 47. While it may be a bit high for a semiconductor company, it's definitely not a meme stock figure.
Oh thanks for sharing this! The fork of llama.cpp for how to do the dynamic quant is here: https://github.com/unslothai/llama.cpp. I also found min_p = 0.05 can help reduce chances of some bad tokens coming up for 1.58bit (I found it to happen around 1/8000 tokens of the time)
Interestingly your description of social cues you expect to pick up on are the exact sort of social cues I struggle with. If someone says something, generally speaking I expect it to be true unless there is an issue with it that suggests otherwise.

I suppose the wide range of negative and positive experiences people seem to have working with LLMs is related to the wide range of expectations people have for their interactions in general.