skysight-inc/HackerNews huggingface dataset:
> The transformer architecture is NOT a Markov process, by mathematical definition of a Markov process. This is not even debatable. It's a mathematical fact.

What, yes it is.

> The attention mechanism in the transformer architecture models relations between tokens within the context window, and does the exact opposite of what you are describing here. This is one aspect of LLMs that violates the Markov property.

The context window is finite, so that is the previous step. You know the dumb markov chains that are based on bag of words? They also look several words back, they don't just go based on a single word. LLMs are just that but with a way larger lookback and some extra logic there, but none of that changes the fundamental parts to make it no be a markov process.

With a large enough context size you could argue it is now fundamentally different in practice, but in theory it is the same. There is no "hidden state", its just the previous n words defines the next word.
'Earthquake' at OpenAI as senior staff quit after sacking of boss Sam Altman
> yet a whole year later no one has a model that even comes close to GPT-3.5 - let alone GPT-4 Turbo

Is that true and settled? I only have my anecdotal experience, but in that it is not clear that GPT-3.5 is better than Google's bard for example.
I've found Harper's and The New Yorker educational for good composition and writing style.
The big issue I see with trying to compare the DSP profiles of two different clips, as recorded by a cheap consumer microphone in a compressed audio clip is that we're unable to tell whether asahi's DSP is actually better or just happens to match the sweet spot of the phone's microphone DSP profile.
You'd need unique signature of cell phone signal to separate it from other cell signals

In terms of timestamp, when multiple satellites measure different times of receipt from same cell signal they could reverse compute the location

Could probably incorporate differences in received signal strength as well

At least thats my guess

I don't think you'd wanna use timestamp info from the sender, since you have no control over the accuracy of that, even if it was available
Amateur radio operators with just a moderate bit of gain (small uda-yagi antenna or the like) uplink to LEO satellites with ~5 watts all the time. At peak power a cell phone can be about 3 watts... but their antennas are not directional. So that loss of ~8dB of antenna gain has to be made up by increasing the sensitivity or gain of the satellites in LEO by increasing antena aperture or better front end low noise amplifiers. It's all very feasible given the clear line of sight.

What's less feasible is having enough of these at good positions overhead of a single cell phone to multi-laterate it's position using shared timestamps on the downlinked spectrum from multiple satellites.

I think it's entirely feasible with the budget of a medium space services corporation that can launch 21 satellites.
Because it's the reason he got fired.

https://www.plainsite.org/posts/aaron/r8huu7s/
I just started the Japanese course recently and was trying to figure out why a bunch of the criticism I read of Duolingo's course seemed irrelevant or inapplicable. I guess this pivot explains why to some degree.
I think the engines worked perfectly. The booster broke up in the middle, at least it looks like it on the everyday astronaut feed.
> split the company into two camps

The split existed long prior to the board action, and extended up into the board itself. If anything, the board action is a turning point toward decisively ending the split and achieving unity of purpose.
While technically true, in practicality, they did give money to the non-profit. The even signed an agreement stating that any investments should be considered more as donations, because the for-profit subsidiary's operating agreement is such that the charter and mission of the non-profit are the primary duty of the for-profit, not making money. This is explicitly called out in the agreement that all investors in and employees of the for-profit must sign. LLCs can be structured so that they are beholden to a different goal than the financial enrichment of their shareholders.

https://openai.com/our-structure
Not at all. Prior to WWI, the US was aggressively and intentionally cleaning European interests out of the Western hemisphere. It was in frequent wars, often with one European power or another. It just didn't distract itself too much with squabbles between European powers over matters outside its claimed dominion.

Establishing a hemispheric sphere of influence was no act of neutrality.
Here’s another theory.

> the ousting was likely orchestrated by Chief Scientist Ilya Sutskever over concerns about the safety and speed of OpenAI's tech deployment.

Who was first to launch a marketplace for GPTs/agents? It wasn’t OpenAI, but Poe by Quora. Guess who sits on the OpenAI non-profit board? Quora CEO. So at least we know where his interest lies with respect to the vote against Altman and Greg.
Me, apparently. I think it looks gorgeous. I don't speak any languages that are written in Cyrillic and I don't like ligatures in code. But I want that 1970s Unix feeling...
So? Just make sure you regularly refresh the statistics...
Other peoples Ideas and other peoples money, pretty on topic.
Yes. These systems are for control, not general purpose law enforcement.
Have they gotten specific yet? Last I heard was the whole “not sufficiently candid” thing, which is really nebulous; hard to call it a farce really. It is a “to be continued.”

I’m going to wait and see before I get too personally attached to any particular position.
The split happened at the management/board level.

And instead of resolving this and presenting a unified strategy to the company they have instead allowed for this split to be replicated everywhere. Everyone who was committed to a pro-profit company has to ask if they are next to be treated like Sam.

It's incredibly destabilising and unnecessary.
David Brin has idea after thinking about future making surveillanace unavoidable. The solution is that everybody can spy on everybody else. The problem is that the government and corporations can spy on us, but are immune. I'm not sure if he means it as blueprint or inevitability with the price dropping.

I think he is wrong that everybody spying will help, when everybody discussing online doesn't. But it is useful to think about what world will be like when everybody can surveil.
Welcome to Rands Leadership Slack
Venture capitalists and entrepreneurs will sell this country and our freedom for a dollar, ego, and power. It's already happened and is happening at increasing rates.
Google is a company that builds a lot of tech but derrives most of its revenue from advertising. I actually think that makes it better at tech than pure tech companies. It tends to mean the PHBs who are more concerned with the revenue stream don't get as much in the way of the engineers as in companies where tech is the revenue earning product.

Similarly in the open source world corporate sponsership is very helpful in allowing people to dedicate large chunks of time to things by employing them to work on open source (because its hard to do good work quickly on evenings and weekends) but corporations are usually bad if they try to control the development. That's why projects like the Linux Kernel do so well because corporations pay for hundreds to a few thousand developers but don't get to stick their oar in on technical decisions.
read the room.
Hey HN,

These claims that op has made have been found to be false. His project uses an Open MIT license, and I forked it like a good OSS community member does.

The main dealer breaker for me not using his code directly within my project was a serious GDPR and data privacy violation that I found on the surface of OP’s code.

https://github.com/avitorio/outstatic/blob/d440f8f53ee559fb3...

There is no disclaimers or privacy polices within OP’s website, project, or readers that say he is collecting analytics data, including sensitive GitHub project details.

Some of my users and customers require ISO2700 and SOC2 compliant solutions, and this was a huge red flag to us.

I contacted OP about it, and other security issues, but he blew me off and turned to trashing me online like this.

What do you think?
The web API based licensing scheme is dumb and bad. It’s including a buggy whip holder on a model T thinking. The license should be that they sell a license for use of the weights. They can also sell a SaaS that does a web API to use the weights. But the weights are the thing other businesses actually want and it’s controlling and obviously a monopoly play to not sell the weights. Other businesses have an obvious incentive to only work with companies that sell weights so as to prevent their being mere serf’s on someone else’s SaaS farm.
The threat of bioterrorism is in no way enabled or increased by LLMs. There are hundreds of guides on how to make fully synthetic pathogens, freely available online, for the last 20 years. Information is not the constraint.

The way we've always curbed manufacture of drugs, bombs, and bioweapons is by restricting access to the source materials. The "LLMs will help people make bioweapons" argument is a complete lie used as justification by the government and big corps for seizing control of the models.
https://pubmed.ncbi.nlm.nih.gov/12114528/
I'll wait for this to be TLDR'ed through ChatGPT. It uses a lot of high speak, it seems to conclude that nano-particles not just plastics have an effect on proximity to neurons under the right conditions.
Too many hands in too many cookie jars, this feels like.
There are plenty of places. Under a forest canopy. Underground, under a large overhang from a cliff. And those are just the types of privacy you don't create for yourself, or you don't naturally get through large structures.

They aren't necessarily convenient places, but it's not like you can't find any privacy just because there are cameras up high pointing down. It's actually probably far less intrusive and privacy destroying than the electronic device you likely carry everywhere with you that reports you location and could (if it doesn't already) keep track of when it can't report and relay it when it can again.

If you think the trade-offs of that make it worthwhile most the time, consider that there may be trade-offs here that are positive that you are discounting with what we're discussing here.
Selectively generate highly likely images of politicians in compromising sexual encounters based on the people that are attractive and they work with a lot in their lives.

Use to power of LLMs to mass denigrate politicians and regular folks at scale in online spaces with reasonable, human like responses.

Use LLMs to mass generate racist caricatures, memes, comics and music.

Use LLMs to generate nude imagery of someone you don’t like and have it mass emailed to the school/workplace etc.

Use LLMs to generate evidence for infertility in a marriage and mass mail it to everyone on the victims social media.

All you need is plausibility in many of these cases. It doesn’t matter if they are eventually debunked as false, lives are already ruined.

You can say a lot of these things can be done with existing software bits it’s not trivial and requires skills. Making generation of these trivial would make these way more accessible and ubiquitous.
No clue, but I guess not.
Did you see the video I linked or are you just playing a game of repeating your beliefs?

Even electric cars at city speeds are above 75dbA, which may be of course less than a loud combustion motorcycle, but nonetheless already into "loud" territory.
Depends on the version. They have thousands of m.2 in stock.

https://www.mouser.com/c/?q=coral
OpenAI is a nonprofit charity with a defined charitable purpose that has a for-profit subsidiary that is explicitly subordinated to the purpose of the nonprofit, to the extent investors in the subsidiary are advised in the operating agreement to treat investments as if they were more like donations, and that the firm will prioritize the charitable function of the nonprofit which retains full governance power over the subsidiary over returning profits, which it may never do.
Then maybe the conclusion is don't spend millions to research that type of thing.
Importantly, even if noncompetes aren't enforced, trade secrets can still be grounds for litigation against a former employee. They can't just go from one employer to another and take all the secret sauce recipes with them.
> working on a free / open source api docs tool, https://github.com/scalar/scalar

> scalar.com

damn son, that namecheap paycheck must have been a pretty penny.

also congrats on figuring out a way to deal with non rule following players while you yourself followed the rules. i would have broken the rules just as those guys did and if i made money from it then try to properly license the fonts or if i didnt make anything then no harm no foul (can't squeeze blood from stone).
okay but I personally do want new LLM toys. who is going to provide them, now?
"bio-degradable packaging"

That is the thing: they rot. And if wrapped in plastic, they last longer ... so more fruit makes it to the markets. That being said, I strongly prefer fruits directly from trees that were not treated with 50+ different chemicals.
Yes, sure; but you're leaving out issues of signal fidelity due to noise.
This seems like an uninteresting test. Nobody (almost) is implementing sorting algorithms in their day job. We use libraries. It's like asking people who claim to not struggle with driving basics to change their spark plugs and saying "aha, I new you were an idiot".
OpenAI recruits employees based on equity packages that will not amount to anything based on their operating agreement.

Live and learn I guess.
They don’t have to pay him an exit fee.
Researchers' 'cooling glass' blasts building heat into space
How does it compare to the search done without any encryption?
> Did you mean to write optimistic? Otherwise this statement appears to be a tautology.

The point I was trying to make, a bit fumblingly, is that even pessimists assumed that we would initially have control of Skynet before subsequently losing control, rather than deploying Skynet knowing it was not reliable. OpenAI “go rogue” by default. If there’s a silver lining to all this, it’s that people have learned that they cannot trust LLMs with mission critical roles, which is a good sign for the AI business ecosystem, but not exactly a glowing endorsement of LLMs.

> I know, I've done it myself. The ethical implications of the use of a tool lie on those that use it. There is no AI safety problem for the same reasons that there is no web browser safety problem.

I don’t think this scans. It’s kind of like, by analogy: The ethical implications of the use of nuclear weapons lie on those that use them. Fair enough, as far as it goes, but that doesn’t imply that we as a society should make nuclear weapons freely available for all, and then, when they are used against population centers, point out that the people who used them were behaving unethically, and there was nothing we could have done. No, we act to preemptively constrain and prohibit the availability of these weapons.

> Normally we'd try to structure safety protocols around actual threats and risks that had happened in the past. Our society is now sufficiently safe and maybe decadent that people aren't satisfied with that anymore and thus have to seek out non-existent non-problems to solve instead.

The eventual emergence of machine superintelligence is entirely predictable, only the timeline is uncertain. Do you contend that we should only prepare for its arrival after it has already appeared?
Google built transformers

talk all you want about it's an ad company and da did da, in the end the whole LLM revolution is built on their tech
As someone who's used BS & Silverlight, I would say they are not alike except very superficially (XML for layout - but Android also has that).

I'd have to look quite hard to find a language I like less than BrightScript, it's horrible.
This capability has existed at least 70 years and improved over time. See also: TRUMPET, Rhyolite, Magnum, Mercury, Orion.
Yes, you're right -- I dug around in the Wikipedia article, and it turns out he even confirmed in an email it definitely wasn't him: https://www.beyond3d.com/content/articles/8/

Thanks for the correction, edited the post.
I don't disagree that this may have been ham-fisted or that it may have been a huge mistake. But I do think that talking to investors in the for-profit arm of the company about potentially removing the figure head has an even greater potential to backfire. There's absolutely zero chance that information wouldn't leak before they could make their move. And while it might be a nice gesture to Microsoft to inform them of their decision, the truth is that Microsoft has no stake in the non-profit OpenAI and did not have any right to know of these decisions as they were being made.
You forgot reusable.
Employees don't hold ownership of that intellectual property, though. You're speaking almost in terms of a moral right; IP rights are legal rights of convention. An employee isn't entitled to them in the same way.
Ousted OpenAI CEO Altman planning new AI venture, sources say
The board ousting the board chair (without notice) and the CEO is a coup. It's not even clear to me it was legal to meet and act without notice to the board chairman.
This capability isn't new.
Well, if it’s not good then who cares. If it is good, but subversive for lack of a better term, then that strikes me as worthy. Most work done in that spirit is bad because it’s low quality, not just because it’s agenda driven. I’m all for quality over purity, if it gets more people to read and enjoy.
I read a story in this article about a person being sued after they found another job after they were laid off.

There should be exemptions for non competes when it's the company firing or laying off the employee. When a company decides to do that, they need to be willing to bear the consequences of their decision.
It's hard to make any kind of objective assessment based on a single article this sparse on concrete details as this, but I get strong vibes of a day-dreamer personality. This oscillation between excitement about an idea, and the hard reality and challenge of actually making progress. I have these tendencies at times myself, and my first piece of advice is to bring some structure and accountability to other people into your approach. In my case two things were game changers: studying CS with an actual teacher and classmates, as well as going and getting a professional job.

I had done a lot of self-taught stuff as a teenager, but honestly the essence of programming eluded me until 12-18 months into my CS undergrad. A lot of it was just the reps, but the structure of having a dedicated professor and assignments gave me a focus that really helped. I also think it was good to work primarily with backend languages like C, C++, Java and Scheme without the distraction of web and GUI elements that have a world of complexity (often incidental) that distracts from understanding the basics of data structures and algorithms.

The next big leap was working on a team in a professional setting. In my case it wasn't even with other programmers, I worked primarily with non-technical stakeholders as the sole web designer and programmer on a design team that primarily did print design (yeah this was a while ago). Even though I didn't have technical mentors in that first job, just the accountability of having to deliver on some projects that multiple people were contributing to taught me a ton about how to do what was necessary to consistently ship. This is the number one thing to improving: you've got to ship and keep shipping. If you get stuck, cut scope and ship something simpler. Just never stop shipping.

Finally, a word on motivation. I'm not here to judge anyone's motivations: do whatever works for you. That said, I feel the best motivation for getting good at programming is curiosity about how things work. If you're not innately curious about technical things, the steady stream of compiler errors and bugs will eventually grind you down. Perhaps this is what the title is referring to. Personally I don't think of programming as hard, but that's because the high I get from debugging a thorny issue outweighs the pain of understanding the root cause. Multiple times the author discloses an expectation that something should be easy, and then getting frustrated when it's not. Whatever your motivation, you've got to have some tenacity and grit to put in the work to power through—that's how it will become easier over time, not due to innate intelligence or time spent on tutorials/videos/reading materials.
Isnt that how most ai is built anyway? Taking what’s not theirs and selling it for profit?
I agree it isn’t but the point I was trying to make is that when you have to do something from scratch, on your own, even if it’s simple, it can be a challenge. My example was poor because I am typing fast sitting in a car parking lot and I hate typing my thoughts on phones.. Forgive me..
> Unlike previous attempts at cooling coatings, the new UMD-developed glass is environmentally stable—able to withstand exposure to water, ultraviolet radiation, dirt and even flames, enduring temperatures of up to 1,000°C.

OK, the "microporous" glass is "stable" against dirt--in the sense of permanent damage--but that's not really the same as continuing to work when dirty.

How easy is it to wash dirt out of all those micro-pores, and how often would someone need to wash their building to really use its special properties?
Will this be good or bad for the general public?
>Never attribute to malice that which is adequately explained by stupidity.

Sufficiently advanced stupidity is indistinguishable from malice.
Yes indeed. You can see for example here what kind of lead times are we talking about: https://sar.iceye.com/5.0/productguide/ordering/

Any serious military is tracking all known imaging/SAR satellites and uses their fly-by times (which are entirely predictable) for moving stuff covertly. I.e. you want to be out in the open in Area 51 testing a new RQ-180 derivative only when no one can be looking at you right now.

Also, there are global ADS-B satellite relays, and frankly I don't know why this data wasn't logged for MH370 - it must be explained somewhere. There's a guy on Twitter who captures those on a custom antenna + BladeRF setups (this data is plugged into adsbexchange for oceanic routes coverage). AIS relies even more on satellite relays, as the curvature of the planet limits signal propagation much more than for airplanes. What you see on any AIS website is mostly from a satellite.
It sounds like Sam wanted to turn OpenAI into Apple with an app store and revenue sharing and hardware designed by Jony Ive—except in about one year instead of the ~30 it took Steve Jobs. This alone could land the company in hot water with the California Attorney General given the non-profit charter. If a single dollar was invested in making any of that a reality, that would count as a misuse of non-profit funds and lead to serious problems when it came time to file Form RRF-1, scheduled to be filed yesterday, the day he was fired. Everything else is sort of besides the point.
> Support for coral is… shaky at best. There are some indications that the production of these devices has largely stopped (and finding them to purchase is hard and expensive,) and maintenance of the drivers and libraries to interface with coral seems to be minimal or non-existent to the point where some Linux distributions have started dropping the relevant packages from their repositories.

I've recently gone through the process of trying to install pycoral on Rocky Linux 9. I had to build from source, and there was some challenge because documentation for the build process was sparse. There was some conflicting information about files I had to edit, values I had to set, what was supported and what wasn't.
As someone else commented on this page, it wasn't a coup.