skysight-inc/HackerNews huggingface dataset:
Great question! PeerDB can be just run on a single EC2 instance (using either Docker or Helm charts). A typical production-grade setup could use 4 vCores with 16GB RAM, You can scale up or down based on resource usage for your workload.

To elaborate more on the architecture (https://docs.peerdb.io/architecture), the flow-worker does most of the heavy lifting (actual data movement during initial load and CDC), while the other components are fairly lightweight. Allocating around 70-80% of provisioned resources to the flow-worker is a good estimate. For Temporal, you could allocate 20-25% of resources and distribute the rest to other components.

Our open-source offering (https://github.com/PeerDB-io/peerdb) supports multiple connectors (CH and non-CH). Currently, there aren’t any plans to make changes on that front!
I won't directly answer your questions but consider this. We have a function F that accepts an argument of size N and returns the result after N² instructions. Its time complexity is O(N²).

Now consider F'. F' is like F but we limit N to a fixed constant -- for example we say that N must be ≤ 2³². In this case, _for every input_ F' returns the result after at most (2³²)² = 2⁶⁴ instructions. Its time complexity is O(1). Note that O(2⁶⁴) = O(2⁶⁴ * 1) = O(1).

---

Technically, all implementable-on-real-machines algorithms either return after O(1) instructions, or loop after O(1) instructions. But being O(1) doesn't imply being fast in practice.

You might be also interested in reading about galactic algorithms: https://en.wikipedia.org/wiki/Galactic_algorithm.
Surely HN of all spaces would understand there are far more chip manufacturers than just Intel.
I vote for PIP's just being for documenting purposes for CYA.
It should be just as easy as adding:

authenticator="externalbrowser"

Adding a Snowflake connection configuration option that allowed for standard Snowflake connection conventions might be a good option. That way you could connect to Snowflake with your existing configurations (.snowsql/, .snowflake/). Or explicitly specify by adding matching args/params to your project's config.

# myconf.toml
[test-connection]
account=mysfaccount
authenticator="externalbrowser"
...

# config/config.yaml
source:
type: snowflake
connection:
file_path: test-connection
name: ./myconf.toml
change_tracking_database: melchi_cdc_db
change_tracking_schema: streams

sf.connect(connection_name=?, connections_file_path=Path(?).resolve())
Yea, I call BS on 100Gb uplink for $1000. I have racked a lot of servers at different data centers. No way.
> This migration took the industry years because it was not that simple.

It was not that simple, but it was not that hard either.

It took the industry years because Python 2.7 was still good enough, and the tangible benefits of migrating to Python 3 didn't justify the effort for most projects.

Also some dependencies such as MySQL-python never updated to Python 3, which was also an issue for projects with many dependencies.
I hate it when some nerd on HN snipes me on aquatic animal military roles
For Item 2., it's also "maybe they'll leave on their own and we don't have to give them a severance package."
What if I obscure the last 2 digits of the IP
The key enabling tech is thread safe reference counting. There are many other problems that Sam Gross solved in order to make it happen but the reference counting was one of the major blockers.
> No, AT&T is not going to push your complaint up the line to XO. Haha. No.

Maybe not my complaint... but I'm sure there's somebody that could do it.

Who would you have to be, to be able to convince AT&T to bother their fiber vendors for you?

Could, say, the NSA get a routing loop fixed within an hour just by shouting into a phone?
I suppose there could have been something like Q derives from Mark but overwrites or omits some details, then Matthew and Luke are written by authors with access to both Mark and Q but are unsure which source has precedence.

This rooted hypothesis would still have Mark be the source of all gospels.
You just have to drug them first.

https://williamgibson.fandom.com/wiki/Jones
Accusations like this have to be founded on serious grounds, otherwise you make the whole argument appear foolish.
lack of UDF is an issue
Pramila Jayapal most notably.

Donald Norcross in the Labor Caucus has been a major blocker as well because most of these CHIPS projects are being built independent of AFL-CIO in a lot of cases.
That is not fair. They did not actively kill hundreds of people.

They just waste some energy on suboptimal chips and business decisions.
Do good work and your fits will follow
Outer Wilds was accurate!

Wooden spaceships, helmets, and other contraptions, augmented with metals and… other “spoiler” materials.

To anyone interested in space with a day or two to spare, I highly recommend playing Outer Wilds. It’s very good and unlike any other game (and I can’t explain why without spoiling the magic).
I worked at a F500 company that used Oracle Cloud. Really impressive how their account executives were able to convince our IT department to go all in on OCI just because we used the Oracle database.
I just bought a gas lens set for my welder and it included cups called the BBW and the FUPA. When I was taking MIG classes, they had a jar of anti-spatter gel called cooter snot tip dip. Can’t imagine why women are so rare in the profession…

I’ve been a tourist in a number of different trades, and welding beats them all for hostility and resistance to safety practices. You get called a pussy for wearing a mask, but of course the manganese fumes from welding steel will give you brain damage. I’ve been advised to run cutoff wheels far above their rated RPM, which risks explosion. It’s sad because welding might as well some combination of knitting and calligraphy but with metal. It’s great.
It's too niche to be a wedge issue nationally, but most investment is primarily in purple districts which makes it dangerous for either party to oppose it without having a downstream impact in donations and even a primary challenge in 2 years.

Same reason why Brandon Williams quickly shut up Mike Johnson even though Mike Johnson could make his life in the GOP and the House hell (not all offices in the CBO have air conditioning despite hellish humidity) - he'd rather keep his seat (NY-22) even if it meant undermining his boss.
Customer being the OEMs.
We expect every foreign nation to influence our elections - even our closest allies. It would be ultra naïve to believe we don't do the same around the world as well.

The "war crimes!" and "acts of war!" crowd - do you understand what you are actually saying?

If taken literally, you're calling for thousands, hundreds of thousands, or millions of people to die because why? Because another nation attempted to influence our election?

What will you or anyone actually do about it? Invade Russia? That's the only thing that can be done about it. Are you volunteering to go to the front and most likely die in a near-peer conflict over some emails?

So... maybe everyone take a breath and calm down. You are allowed to be displeased and unhappy without dialing the rhetoric up to 11.
So uh do we still get to keep our Free A1 VPS with 4 OCPU, 24GB RAM and 200GB Storage...??

If Oracle starts charging the dozens (tens of thousands?) of us that signed up for Pay-as-you-go just to be able to provision a VM, I'm deleting my account.

But in all seriousness, Oracle is a terrible company that has scammed governments and corporations. Not really surprised. Bryan Cantrill said it best [0].
Oracle is "morally bankrupt," Larry Ellison prioritizes profits over ethics and innovation. I'm not surprised if the stock price was forced to fall by Ellison because of his July sells [1]

1. He dumped $322 million (2.25 million shares) in mid July in TWO days signalling lack of confidence

2. These shares were spread out with different sizes, to probably minimize the market impact

3. The sells still pushed the stock prices down

4. Then the "cost-cutting" and OCI layoffs happen

Obviously correlation isn't causation, but Oracle clearly doesn't care about their cloud, just MONEY, HA!

Larry Ellison's Stock Sales - July 15-16, 2024
Date Quantity Price % Change Running Total
-------------------------------------------------------------------------
Jul 16 87,127 $143.17 -0.01% 1,145,732,353
Jul 16 1,037,873 $142.53 -0.09% 1,145,819,480
Jul 15 579,765 $142.64 -0.05% 1,146,277,588
Jul 15 81,871 $143.45 -0.01% 1,146,195,717
Jul 15 237,491 $144.61 -0.02% 1,145,958,226
Jul 15 191,252 $145.34 -0.02% 1,145,766,974
Jul 15 34,621 $146.30 -0.00% 1,145,732,353

[0] https://www.youtube.com/watch?v=-zRN7XLCRhc&t=1981s

[1] https://www.quiverquant.com/stock/ORCL/insiders/
I think that's page 61, 2.1 in this PDF. https://assets.mozilla.net/annualreport/2022/mozilla-fdn-990...

Do funds go from the Corporation to the Foundation exclusively, or is it ever bidirectional? Common knowledge is "If you donate to the Foundation, the Corporation will never see a penny of it for browser development."
I don't like this idea of collecting this tax yearly. I'd skip the power formula and have this tax to be just fixed percentage on every purchase to be able to collect it immediately and automatically by using the banking system itself.

My capital gains tax is immediately collected as my bank sees any capital gains. I physically can't dodge it.

Similarily I could have tax on every purchase I pay for with any kind of bank transfer immediately collected.
First wooden satellite shares material with samurai sword sheaths
Perhaps similar to https://github.com/duckdb/dbt-duckdb , but SQLMesh instead of DBT obviously.
traceroute is a useful tool for (amongst other things) determining where a system is physically. It doesn't always give you enough information.

Traceroute to news.ycombinator.com:

3 96.108.68.141 (po-200-xar01.maynard.ma.boston.comcast.net) 12.105ms 11.724ms 11.931ms

4 96.108.68.141 (po-200-xar01.maynard.ma.boston.comcast.net) 13.011ms 10.727ms 19.861ms

5 162.151.52.34 (be-501-ar01.needham.ma.boston.comcast.net) 13.988ms 14.721ms 12.921ms

6 162.151.52.34 (be-501-ar01.needham.ma.boston.comcast.net) 14.999ms 16.688ms 12.997ms

7 4.69.146.65 (ae0.11.bar1.SanDiego1.net.lumen.tech) 76.044ms 79.624ms 78.017ms

8 4.69.146.65 (ae0.11.bar1.SanDiego1.net.lumen.tech) 83.962ms 108.675ms 78.987ms

9 \* \* \*

I can conclude that the server is probably on the west coast -- maybe San Diego.

I recall using this during a sales pitch by some IP Geolocation company that were very proud of their technology. The example that they used, they claimed was in Morristown, NJ. A quick traceroute (from Massachusetts) revealed that the IP was somewhere in the UK as the last hop was close to Heathrow Airport. We did not purchase their solution!
The Spiral of Wrath: The crash of Armavia flight 967
He is so much biased against AMD that PC builders and even Intel forums have banned that site.
All of the Big Tech companies should be split up. Every single one.
I like how latin names for such organisms are (intentionally) so fitting: "radiodurans".
Do you have some secret intel? They make the best chips in the USA.
So First Amendment rights for corporate websites overrule citizens, interesting take.

And corporations have to uphold other constitutional rights, why not citizens first amendment too.
That is the problem that got them into this situation in the first place.

No consistent leadership vision or direction - do everything and anything their staff wanted, almost none of which was actual tech. They hired activists - not technologists.

Look at the results.
I come from Coventry. More damage was done after the war by the city council than the Germans ever did.

It is one of the few places that I think should have been permanently wiped off the map. It's been an absolute hole since the 1970s.
they have UDFs: https://duckdb.org/docs/api/python/function.html
Using Two ReMarkables
I think the "The Worst Diagnostics In The World" section is a bit simplistic about what traceroute does tell you. It can tell you lots of thing beyond "you can reach all the way". Specifically, it can tell you at least some of the networks and locations your packet went through and it can tell you how far it definitely got. These are extremely powerful tools as they rule out lots of problems. It's useful to be able to hand an ISP a "look, I can reach X location in your network and then the traceroute died" and they can't wonder "are you sure your firewall isn't blocking it?"

It's still a super-common tool for communicating issues between networking teams at various ASes. That the author's ISP thought they were too small to provide reasonable support to is not a strike against traceroute. Rather, it's a strike against that ISP.
extradition
I think a lot of people would consider alternatives if there were some. Sourcing AMD hardware is a PITA, even just renting for validation. On the consumer side, AMD announced they are done with top end GPUs for the time being.

I agree with you on marketing but Nvidia's relationships with the big cloud providers and big companies is more important. It locks AMD out.
One of their premiere titles - battlefield.

I assume they test in prod on their billion dollar title because it sure felt like a daily stream of nightly builds.

Can't believe that circus has a market cap of 40bn. You kidding me? Their launcher barely does what it says on the tin reliably - launch things
As long as you're the only one doing the troubleshooting, sure. FTA:

> The example given is that a handful of users running MTR (do not get me started on this bastard program) can actually hit this rate limit. This is an outstanding example because I have seen something similar in practice.

> Consider what that would look like, and how common it would be: If you have a NOC full of people who think they know what they're doing, but don't, that only enhances the probability that everyone is trying to troubleshoot on their own instead of doing a screenshare and coordinating their efforts - thus, you have six guys running MTR to the same IP.
I once worked at a company, that bought a lot of unnecessary software, because they knew they need a database, but didn't knew what a database actually is.
I am one of the authors of this open source project Agent-E. I would love if people here give it a go:
https://github.com/EmergenceAI/Agent-E
It doesn't have any vision yet, all clever DOM manipulation.
We have a Discord for feedback and welcome contributions to make it better.
That might be true in consumer space, but enterprise ones are those shelling tens of billions and they don't care about marketing but what's fastest per money they spend (also in electricity, maintenance, etc).
Why only midnight? Why not when it's idle?
Maybe you should check with nurses, emergency rooms, and healthcare. eBikes are second only to eScooters for injuries[0]. You're also far more likely to hurt other trail users.

On roads, speed doesn't always save you against other motor-vehicles, if that were true sport bike riders would never be hit. Behaving in a way that other road-users don't expect also puts you at risk (where did that bike come from?!)

[0]: https://pubmed.ncbi.nlm.nih.gov/39042404/
aaand that's enough internet for me today.
I shall elaborate on the first paragraph of the web page:

• Terse.

Xᴇɴᴏɴ is as terse as ᴊꜱᴏɴ using 3 characters per scalar value <key=value> rather than ”key”:value, (4) or ”key”:”value”, (6). Xᴇɴᴏɴ is significantly more terse than xᴍʟ <key>value</key> (5+len(key)) around 10.

• Readable multiple line indented text.

ᴊꜱᴏɴ does not support multiple line text, forcing one to escape newlines as ‘\n‘. xᴍʟ looks messy with multiline line text as the text is copied verbatim, indenting is therefore from the left of the page. Xᴇɴᴏɴ allows one to indent text more than the enclosing markup.

Native support for arrays

Awkward in xᴍʟ.

• Native support for a graph structure, elements may have multiple parents.

Both missing from ᴊꜱᴏɴ and xᴍʟ where special fields are layers on top of the markup.

• Native support for a types used in serialization.

Also missing from ᴊꜱᴏɴ and xᴍʟ.

• Unambiguous choice of data structure.

No attributes.

• Efficient to write by hand.

see Terse. Also supports comments unlike ᴊꜱᴏɴ.

• Can be implemented to be blazingly fast or using a mode-less tokenizer.

Design decisions took performance and grammar simplicity into account.

• The xenon document is named.

Useful. One can see that the document is a <Person> or <Example-Document>
Is your website tested? or you are
>The CHIPS act is a huge Biden policy win so you can bet the GOP will want to repeal it.

It does seem like politics at the presidency now is less about what you'll do and more about undoing everything the other side did during their time in office, regardless of utility or popularity of what it is.

Is it me or is this worse now? Had it always been like that and I'm just now seeing it?
Isn't that ahead of schedule?

Everyone I think knew AMD is catching up but thought this was still a year or two out
> On the consumer side, AMD announced they are done with top end GPUs for the time being.

You reminded me of the many "let's hope that the next AMD GPU is super fast so Nvidia cuts the prices on their XXX GPU" I regularly see on hardware boards.
With Anon being marketed as a private, no-login AI assistant, I'm curious about the trade-offs involved. Does this privacy-first approach impact the assistant's capabilities compared to other more data-driven AI tools? Has anyone tested it out in real-world scenarios?
Real awesome project. This would be even better if some of the differential storage functionality makes its way into duckdb.

https://motherduck.com/blog/differential-storage-building-bl...

Unsure if it's even possible, but if there was a way to write out (simulate) the streams to WAL files, you might be able to accomplish the same without having to consolidate the duckdb file every time.

A couple of other ideas, that may or may not diverge from your project's purpose or simplicity...

It's also too bad that duckdb isn't included in the out-of-the-box Snowpark packages, potentially allowing you to run all of this in a Snowflake procedure/DAG and persisting the duckdb file to object storage. You could of course achieve this with Snowflake containers. (But this would probably ruin any plans to support Redshift/BigQuery/etc as sources)

If the source tables were Iceberg, then you could have an even simpler duckdb file to produce/maintain that would just wrap views around the Iceberg tables using the duckdb iceberg extension.

create view x
as select
*
from
iceberg_scan('metadata_file');

If you're going to enable change tracking on tables then perhaps another solution is to use CHANGES to select the data from the table instead of reading streams. That way you could use the same timestamp across all the selects and get better consistence between your materializations to duckdb.

set ts = {last_materialization_ts};
select * from X CHANGES AT(timestamp=>$ts);
select * from Y CHANGES AT(timestamp=>$ts);

-- triggered task to kick off materialization to duckdb
create task M
when
SYSTEM$HAS_DATA(X_STREAM) AND
SYSTEM$HAS_DATA(Y_STREAM) AND ...
AS
CALL MY_MATERIALIZE(); -- send SNS, invoke ext-func, etc

Here's another similar (but different) project that I've been tracking https://github.com/buremba/universql
Lots of industries are very consolidated now, from Banking to Telecom cartels and yes, big tech too.

As a libertarian, I propose that in addition to this, we as a developer community also try building good open source software to take on Big Tech, and not simply rely on one giant monolithic thing (Big Government) to save us from another giant thing (the Big Tech oligopoly).

Here is how we can take back our communities without waiting for Big Government to rein in Big Tech (which, with Vance and Musk and Google and Facebook and Microsoft & OpenAI, will only capture it more, considering how much they spend on lobbying)…

https://www.laweekly.com/restoring-healthy-communities/

We are lucky that Facebook has open sourced Llama (making lemons out of lemonade after that fiasco with the researchers leaking the weights). Imagine if they didn’t. Would breaking up OpenAI and Google DeepMind into smaller companies somehow help the little guy?
They broke up Ma Bell DECADES AGO and long distance calls still cost $3 a minute. Why? It is only when open protocols for VoIP came out did the cost drop to near 0 overnight.

Open and permissionless protocols like SMTP and HTTP were the reason that the walls of AOL, MSN, Compuserve and other walled gardens fell. Not any government action. AOL open sourcing netscape is the reason we even got Mozilla Firefox and competition to Microsoft’s browser monopoly which they got with their “embrace, extend, exintnguish” strategy.

There WAS an antitrust case against Microsoft. But it was the presence of viable open source competition to their internet browser that was far more important. Konqueror led to WebKit, which led to Safari and then Chrome. Firefox was always there as well. This stuff matters. Government antritrust by itself won’t save you from the problems of Big Tech.
SemVer is over promised and an under delivered scheme. There’s lots of literature about the difficulty about what “compatibility” means.
I’ve been enjoying doing what I call “siphoning pennies from Larry Ellison” happily via the “always free” OCI tier for almost a year now. I know, given the stewards of this, that “always free” is an empty promise that will eventually go away, but I’m enjoying it while it lasts.

I used https://github.com/jpetazzo/ampernetacle to provision resources and it’s been the “brain” for my personal cloud for this whole time. It doesn’t run much, basically ArgoCD, Tailscale operator and a CoreDNS deployment that does internal routing, but heck, it’s a free highly available control plane for an internal homelab. No other cloud even comes close to OCI’s offering, if you were to provision the same on other clouds it would be minimum $50 USD+ per month

Once it finally dies I’ll probably just go find some low cost provider like Hetzner or OVH to run this. I’m purposefully not really doing much on that instance as a result because I know that my small little bundle of terraform that builds out the vm’s will eventually need to be rewritten, so I’ve also purposefully avoided using any OCI specific constructs for my implementation.
What are the results? I can't seem to Google that and get anything meaningful.
I’ve been following them for over 20 years. Mozilla’s problem is idealism. One project to the next. At the end day, you have to pay your bills.
And then what? Ma Bell was split up, and longn distance calls still cost $3 a minute for decades. Then Voice over IP took the cost down to near-zero practically overnight.

The key is in an open and permissionless technological alternative.
What's wrong with Firefox? It's my daily browser and works great. What am I missing?
They address that in the PEP.

It would basically mean a new major version every year as they remove things that have been depreciated.

Which isn’t really that useful.
You can google Firefox market share, Thunderbird market share, Mozilla's financial standing over the past two decades, all of their failed social justice endeavors, etc.

The company rotted from the inside by allowing the inmates to run the asylum. Now Mozilla is severing the limb responsible for endless side-quests - but probably way too late.

FTA: "Fighting for a free and open internet will always be core to our mission, and advocacy continues to be a critical tool in that work. We’re revisiting how we pursue that work, not stopping it"

How about you just make the best damn web browser imaginable?

One of the most important and influential technology companies ever ate itself into a failed advocacy group with a couple mediocre tech hobbies. What a joke...
Save the internet and smash the tech industry to pieces. Beer in America got much better when they made it easier for small breweries to compete
That’s called Mongo pushing ;)
Thank you! Will take a look at this over the next few days