skysight-inc/HackerNews huggingface dataset:
He went into the details of how he thinks about open sourcing weights for Llama responding to a question from an analyst in one of the earnings call last year after Llama release. I had made a post on Reddit with some details.

https://www.reddit.com/r/MachineLearning/s/GK57eB2qiz

Some noteworthy quotes that signal the thought process at Meta FAIR and more broadly

* We’re just playing a different game on the infrastructure than companies like Google or Microsoft or Amazon

* We would aspire to and hope to make even more open than that. So, we’ll need to figure out a way to do that.

* ...lead us to do more work in terms of open sourcing, some of the lower level models and tools

* Open sourcing low level tools make the way we run all this infrastructure more efficient over time.

* On PyTorch: It’s generally been very valuable for us to provide that because now all of the best developers across the industry are using tools that we’re also using internally.

* I would expect us to be pushing and helping to build out an open ecosystem.
China is subject to so much arm chair analysis that the hubris here is now not even funny. It is on verge of collapse for last 20 years. People are about to revolt for longer and there won't be any original product /research. They are attacking Taiwan anytime now for 30 years.
This is something I've been struggling with recently. After a few years of adding customers at a fairly slow rate, this year I've already doubled the amount of customers I have. Unfortunately, it still isn't enough to hire an employee. I've gone from ramen profitable and doing freelance to fill the gap, to ditching freelancing altogether and working on the application full-time.

The first mistake I made was not saying no to customers. I ended up putting in basically 3 months of work between two customers adding features that would only benefit them. After that, one of them still wanted more, but I was at the end of my rope at that point and told them no.

Now, because I have more customers, I get a lot more support and feature requests. I've been trying to streamline support by setting up a better system for tracking these tickets as some have been slipping through the cracks. I've also been trying to put as much information in my support documentation as possible. Unfortunately, the feature requests have pulled me away from both of these efforts. There are just SO MANY feature requests.

To deal with the feature requests, I've really had to rethink how my application is built. Some things that should have been easy to implement have taken a lot more effort because of sloppy work I did previously trying to get features out. On the plus side, it has made me grow a lot as a software engineer because I can see how everything has played out over the years and I have a much better idea of why things should be built in a certain way. The downside is there are some systems that work and customers depend on, but to do it the right way would be a gargantuan effort. At some point I want to just get rid of them, but it's going to be painful, like sawing off an infected limb.

Once I get through most of the cruft with that, a lot of the new features that need to be implemented will be a breeze and that will hopefully free up more time for marketing, which I do basically none of. That's really the crux of it though. To hire employees I need more growth, for more growth I need to work on marketing. To work on marketing, I need to spend less time on support and feature requests.
Simplifying the Xz Backdoor
Hello! Yes this it the step that comes before Illumina machines as well as every other sequencer on the market. Samples coming out of Callisto can also feed into other sequencers including PacBio, Oxford Nanopore, Element, Ultima and other sequencer on the market.
> I'm aware I can disable this stuff

It's not that simple.

* You can disable some of that stuff, but not all

* Some of your preferences will be reset with the next update

* Some of your preferences will be reset at random

* Some new stuff will be introduced and you will need to disable it individually

* As for some stuff, you will never know unless someone smart figures out something grey is going on under the hood, publishes their research, this research reaches you, and you decide to act on it
The question you should ask is: why are high-profile guests willing to talk to Lex Fridman but not others?

The short answer, imho, is trust. No one gets turned into an embarrassing soundbite talking to Lex. He doesn't try to ask gotcha questions for clickbait articles. Generally speaking "the press" are not your friend and they will twist your words. You have to walk on egg shells.

Lex doesn't need to express original ideas. He needs to get his guests to open up and share their unique perspectives and thoughts. He's been extremely successful in this.

An alternative question is why hasn't someone more charismatic taken off in this space? I'm not sure! Who knows, there might be some lizard brain secret sauce behind the "flat" podcast host.
Nicely done! I've been wanting to build something similar, but as a tool to assist in my history studies.

Oh, and if you are into timelines and their history, you might enjoy Cartographies of Time: A History of the Timeline by Daniel Rosenberg and Anthony Grafton. Very informative read!
Nice hot-take.

Meanwhile, in the world of "things J.K. Rowling is actually saying," she's sliding along the pipeline from trans-denial to some light Holocaust denial, by responding to the statement that "The Nazis burnt books on trans healthcare and research" with a suggestion the person making the statement might have had a "fever-dream."

(Do I personally think she denies the Holocaust? No. Do I personally think she is parroting Holocaust denial talking points because they tend to echo in the same chambers as trans-denial? I think it is plausible.)

Dissent, done in good-faith with an honest desire to learn and respect for the lived experience of those one hopes to gain new insight from, is not hatred. Speaking loudly on topics one knows very little about from a high podium can do far more harm than good, however, and sometimes the difference between hatred and negligence is irrelevant (particularly when one is on the receiving end of the consequences).

For those more interested in where Rowling is coming from and what actual dissent looks like, there's a pretty good video essay on the path from early feminism to the modern TERF way of thinking and the complexities of how one gets there [https://www.youtube.com/watch?v=bpSTMfn-YaU]. It's pretty good, and it's interesting to compare and contrast the discussion on hypotheticals and lived experience in feminist philosophy and how that entire process differs from the kind of fight-picking Rowling does with her podium.
Twitter's Future Is a Return to Elon Musk's Past
>China is far from a depression. Their economy grew by more than 5% this past quarter. That is far from a depression. Where do you come up with this?

Down 50% since covid started.

https://www.lemonde.fr/en/economy/article/2023/08/20/china-s...

https://www.bloomberg.com/news/articles/2023-08-13/china-s-e...

https://www.cnbc.com/2023/08/15/china-is-grappling-with-a-co...

https://www.theguardian.com/business/2023/aug/20/china-too-b...

Though they are probably correct there's no soviet collapse coming, but collapse non-the-less.

Do you feel like these sources are sufficient? Or are they all incorrect?

Isnt it interesting that China's public numbers are always 5-7% growth no matter what?

>There is something seriously wrong with most people. You write things, and hope they are true. It is incredible. It's like Christians and other religious people. If I believe it, it will become reality.

It's also interesting how some resort to attacking people.
The preview is using a different faster model so you're not going to get the exact same styles of responses from the larger slower one. If you have ideas on how to make the user experience better based on those constraints please let us know!
That's coz he is a founder CEO. Those guys are built different. It's rare for the careerist MBA types to match their passion or sincerity.

There are many things I can criticize Zuck for but lack of sincerity for the mission is not one of them.
Reminds me of open source vs free software/GPL years ago, when the internet was taking off.

folks like ESR were weak with their definition of open source and it wasn't as good.

stallman said:

... the obvious meaning for the expression “open source software” is “You can look at the source code.” This is a much weaker criterion than free software ...

https://www.gnu.org/philosophy/free-software-for-freedom.htm...

https://www.gnu.org/philosophy/open-source-misses-the-point....
YEARS ago (2002? 2003?) I'd done some tech training courses in my town. "Learn web dev" kinda stuff. Was very much a part time thing, but I'd looked in to "hrm... could I make this a business?". And learned about the numbers... and learned about ISAs. If I could get accredited(?) as a certain type of school, I could deal with ISAs with students.

I kept looking at the numbers, and couldn't find a way to make this be ... profitable. The time it would take for competent professionals to spend adequate time with folks wasn't something most people could really afford. So... either get them to take out loans, or do an ISA. Neither of those seemed to make sense for the types of students who might most need this, and... it just left a bad taste in my mouth. I enjoyed the teaching part, but couldn't find a way to make it a good business.

Then years later I started seeing all these bootcamps charging thousands and thousands for what seemed to be garbage (mostly). Left another bad taste in my mouth.
You all are crazy. It desperately needs work, but Siri is the only mainstream assistant thing that meets users where they are instead of forcing them into whatever ecosystem it's attached to. Sure, Google Assistant's contextual awareness is super cool, but it only works if you use Gmail, Google Calendar, Google Contacts, Google Tasks, etc.

If we include the umbrella of machine learning stuff in iOS that gets branded "Siri", Siri finds useful connections between my firehose of email from Fastmail, my work Gmail, my text messages, and my Nextcloud calendar and contacts. Completely offline, without even mentioning iCloud.

The voice assistant is extremely clunky and I do hope they'll borrow from LLMs to improve it it, but they really are doing something right here with their modest approach, and "just use ChatGPT" isn't the solution people seem to think.
El Prado Museum – Virtual Tour
"Your time is worth more than any reasonable subscription fee. "

Sure, but what do I do, if that service just closes tomorrow? Or they change the fee to "unreasonable" (after they gained control of the market).

A SaaS would have to be way better than any offline tool, I could use 10 years from now in this shape. But in general yes, don't skimp and loose time, when there is a working alternative.
In fact, can we say it's a kind of global warming? As the balance is disturbed, other things are also disturbed. For example, there was no frost on olive trees in Turkey this year. It was supposed to happen. Because there was no frost on the leaves due to the extreme heat, the viruses did not die and now the viruses in the olive trees have started to ruin the olives. This is why olive oil prices have increased in the country.
Does it "Squeakty Nom Nom Squeakty Squeak"?
I dont. Protected classes are very explicit, and disruptive protesters arent one.
Good question. In the case of delayed replies, it's really getting worse. We often think she didn't hear and start asking again - she heard and she's just thinking about it. Home internet and wifi are fast in general.
They seem to be able to switch out a Raptor 2 in a couple of hours, even quicker sometimes.
It's not impossible there will be some need for maintenance on the Merlins, probably on the injectors I'd imagine, as there'll be some coking build up (it's RP1 not CH4).
I've never been on a team where we've needed a new IC to come in and assess our inefficiencies, question priorities, and lengthen meetings with debates we've already had. There are plenty of management consultants available for that. What we wanted was for an IC to come in and help us meet our goals by churning out more code. There's lots of talk about reputation but no mention of value.
Are you that daft that you truly believe you can say anything you want with no social or other consequences? You can't walk down the street insulting people and not expect society to disapprove of that - and the consequences that come with it. Being ostracized, losing your job, etc.
I was particularly excited for the high HumanEval score, and this is before the 400B model and the CodeLlama tune!

I just added Llama 3 70B to our coding copilot https://www.double.bot if anyone wants to try it for coding within their IDE
Alternatively, buy a PEDELEC e-bike (the one that helps you only when you pedal), dump the car and use it for commuting or trips everywhere for 6 months (100+ miles/week). 4 lbs a week drop and you can eat almost anything. Hilly terrain is no longer a problem either (what would take you 4 hours on a regular bike will be done in 20-30 minutes on an e-bike).
Unsure if this is healthy - but after 12 years it’s by almost completely compartmentalising my mind, and focusing on one thing at a time. Started that habit as a freelancer and it’s probably saved me from burnout multiple times.

These days I feel like my attention is like a lighthouse, I’ll do a half day of finances here - clear my inbox there, a full week on some deadline, etc. its kind of finding a flow. needless to say this works better when your calendar isn’t flooded already

Also I put everything and I mean everything in lists or notion, I’ll put every email to reply to, every feature I need to build every decision I need to remember. The less I’m holding on to the more I can focus without feeling like I’m forgetting something.
Maybe this is more a reflection of the US being civilized or not, but there are teenage “children” the same size as the kid in this story, using actual guns to commit violent robberies in parts of my city. So it’s not trivial to determine whether an adult-sized human holding a black gun is a threat or not.
A CPU is only capable of generating loops so long as one feeds it enough power. In essence it is creating a constant length loop which is bounded by how long the machine is turned on for.

These dominoes are distinct in that they cannot flip the state back and therefore cannot rerun the same sections, and need need more and more dominoes to do more computations, but fundamentally I dont see how that is any different than providing a longer and longer input of energy into a modern computer.

Can you clarify what "orthogonal primitives" are missing?
Rename it to “Sorri”
I worked at a tiny self-funded startup once where we required new hires to update the documentation and processes to fix the problems they encountered during onboarding. That worked great with 12-15 people; not sure how it scales.
Frankly they are getting more. Apple Silicon outperforms budget Intel and AMD processors.
> I like to be on teams for which, if new to the team, mostly you notice things being done sensibly (in context), and the 3 things you see that you don't understand, you can just ask about them, because everyone on the team just wants to work well together to achieve the genuine goals.

I've observed this kind of culture mostly at startups. Once places start to make a lot of money -- things become political.

So if you want to work at the highest paying jobs, you'll have to deal with politics. Because once they make enough money to afford you, the company also makes enough for savvy gatekeepers to entrench themselves in a core system and carve off a piece of that revenue for themselves.
We had some issues with the problems with the vocab (showing "assistant" at the end of responses), but it should be working now.

ollama run llama3

We're pushing the various quantizations and the text/70b models.
Here's the advice I've gotten:

1. Hire a VA for mundane stuff.

2. Hire a coach to fill in your blind spots.

3. Hire the most senior people you can.
CO2 and Lignin-Based Sustainable Polymers with Closed-Loop Chemical Recycling
What's wrong with someone playing with millennia equivalent of millions of human life times worth of income like a disposable toy? /s
Yes, the people who set the priorities have to feel the pain in some way. If you as an employee want your boss to do something, you have to communicate it in a way that makes clear how the problem will affect what the boss cares about, not what you care about. Usually that means translating it into dollars or one of the boss's KPIs, like deployment frequency or support ticket volume.

Sometimes management doesn't prioritize problems because they're short-sighted or overwhelmed. But sometimes it's because they just don't understand how big a problem it really is, and the team fails to communicate it to them effectively.

For example, I've heard devs complain about how "the tests take too long." On one team I was on, a couple junior devs were complaining about this, but it turned out that "too long" meant five minutes. Could they be more efficient? Maybe, but getting that down to one minute would take a lot of work with no impact on our ability to develop and deploy multiple times per day. Once I showed them how to run their tests locally on just the files that changed, the problem was solved. But before that, they thought the problem was "technical debt," when really it was just a training issue. (Or, you know, a lack-of-ability-to-Google issue, but I'm trying to be generous.)

On another team, when I heard this complaint, the team explained that the full test suite took almost an hour, and flaky tests meant that they often had to rerun the tests or merge with failing tests. Needless to say, this had a clear impact on our ability to deliver rapidly with high quality, so this was something I prioritized.

Managers don't do the same work as you, so they don't feel the pain firsthand. And they're often not incentivized to care about the same things as you, at least on the same scale. As an IC, you tend to be focused on the next task at hand. The manager is thinking about their quarterly OKRs or whether the team is on track to meet their sprint commitment. If you want something to change, you have to connect the problems you have on the micro scale to the problems the manager cares about on the macro scale.

And if you can't do that, or your manager won't listen, then yeah: let the problems bubble up until the manager feels the pain, as long as it won't come back to bite you.
TBH, a number like that pretty much seems to be what you get by default when you include any third-party ad system to your site these days. I doubt even the ad company realized how many "partners" they have until they were forced to start counting them.
There is a point here: if your implementation doesn't match the specification, then that can be the case. And your example presumes the specification assumed unbounded numbers, while an implementation did not have them. Well, in that case the specification just needs to be revised to include that information.

But the trick is to remember making the specification model the real world at sufficient detail: not too detailed to make the specification unwieldy, not too relaxed to skip real real-world issues that need to be modeled.

I don't think there are too many good solutions to that, except perhaps theorem provers from where you can also extract code from (e.g. Coq), but it seems either these tools are still difficult to use for engineers, or there is an expectation that models and actual implementations are going to be different anyway, making it difficult to see if the implementation actually implements the spec.
What did you do to remove the news, ads etc.? A while ago I tried relatively hard to delete the news and I couldn’t.
Let’s take a step back and realize you’re attempting to convince me and others that a SIM attack is a larger target than a nuclear missile.
Windows 7 was the first version that finally implemented 1970s-style user-based security successfully. XP was useless if you weren't an administrator, and Vista broke too many things too often.
I was about to comment on this situation, then it occurred to me that I don't really care about personally owned EVs. It's quite a waste for everyone in a city to have one and a garage to store/charge it in, when we could just hail a self-driving vehicle to take us where we want to go.

We don't have this tech deployed now (though Uber EVs are close), and it should be expected soon enough if everyone was working on it instead of selling cars to consumers while they can. For longer trips away from the city I can probably still drive my VW for a while longer.
I could see that if you're evaluating just the imaging, that's a hard call.

Are you provided these details as well?

* Hypertension 20+ years

* Resistant hypertension - four medications with one being a diuretic.

* Early onset hypertension (high school)

* Low potassium

Coupled with the history, Hyperaldosteronism seems much more probable.

There are a ton edge cases/conditions to keep in one's head. I'm sure that's a problem in all domains, definitely medicine.

I wish it could be a multidisciplinary team decision. But then it would become an issue of reaching consensus. And probably too expensive.
Having an engineering mindset is not the same as never making mistakes (or never being too early to the market). The only way you won’t make those mistakes and keep a perfect record is if you never do anything major or step out of the comfort zone.

If Apple didn’t try and fail with Newton[0] (which was too early to the market for many reasons, both tech-related and not), we might’ve not had iPhone today. The engineering mindset would be to analyze how and why it happened the way it did, assess whether you can address those issues well, decide whether to proceed again or not (and how), and then execute. Obsessing over a perfect track record is the opposite of the engineering mindset imo.

0. https://en.wikipedia.org/wiki/Apple_Newton
> According to ChatGPT...

No. Stop it.

edit: I asked it the same question and it answered entirely differently. https://chat.openai.com/share/d214702c-561d-4e4f-96c2-8c66f1...
"Hackers" want to publicly snitch on those with supposed "links" to financial crime and sanctions. Not convictions nor actual sanctions, but links. Like the same brand of hacker that is all in on bitcoin, anarchy, etc? Hackers are shaming agents in service of the State Department now? Sell us another one.

People should not be de-personed because a bank thinks that they are risky. The population, in general, needs to stop pretending that anonymous "hackers" are legitimate justice advocates instead of the likely state actors that they are. Unless they want anything of the sort to be co-opted and then utilized against them.
Ah, year of the Linux desktop...

I'd like for Linux to be an option for desktop computing, but it is not and will never be. Non-enthusiasts are not able to troubleshoot problems in Linux.
I have a MacBook Air that I use for Lightroom/Photoshop so I’ve managed to avoid that issue when moving off of windows.

With that said, I’ve been experimenting with various RAW processing tools on Linux because I’d love to eventually move to Asahi. I do think this remains one of the weakest areas on Linux, but the tools keep getting better. Good to know about Photopea vs. Gimp. I definitely need to try this.
I think that part of his bet is that AI is a key component of getting the metaverse to take off. E.g. generating content for the metaverse via AI
This is mostly from technical report from OpenAI[1]. API performs better as I said in my previous comment. API models(0613/0125 etc.) also uses user data for training which could leak the benchmark data.

[1]: https://arxiv.org/pdf/2303.08774.pdf