skysight-inc/HackerNews huggingface dataset:
Not really. There are good technical reasons for why most MVCC database engines intentionally avoid using transaction ids with enough bits such that they will never plausibly wraparound. More on that in a moment.

Empirically, you need at least a 64-bit transaction id to practically mitigate the possibility of wraparound; even MVCC systems with 48-bit transaction ids have wrapped around in real systems. Consequently, most databases like PostgreSQL are designed under the assumption that wraparound will happen and provide mechanisms for smoothly managing that in the hands of someone that knows what they are doing. No matter how much automatic safety you build into the database, there are performance optimization knobs that enable an incompetent or unskilled DBA to effectively disable or render ineffective the transaction wraparound management mechanisms. This is clearly explained in database documentation.

So back to why transaction id wraparound exists as a thing:

In an MVCC database, each logical record you store usually has multiple transaction ids associated with it that are stored with the record. Because most relational database records are typically quite small, the transaction id overhead in the heap row headers can be a significant percentage of the total storage cost. If you store transactional information in your indexes as well (some do, some don't) the relative space consumption is even worse.

This has an enormous performance impact. A typical row header in an OLTP database is 20-30 bytes. In cases where implementors have shaved a couple bytes off the row header size with heroic efforts, it has generated a 5-10% performance boost across the board due to the more compact representation. The difference between a 32-bit transaction id and a 64-bit transaction id is at least 8 bytes! Yes, you could use 64-bit transaction ids but at the cost of a database that is much more bloated -- and therefore slower -- than the 32-bit version. Since there are good technical solutions to transaction id wraparound, it would be silly to make everyone suffer from poor performance to keep a few poor DBAs from shooting themselves in the foot.

That is not to say you should never use a 64-bit transaction id in a database engine design -- I have, in fact -- but that you should understand the technical tradeoffs and implications.
> My main library resides on a NAS (as in the article), is backed up to 2 low-cost cloud backup providers (still much cheaper than hosting a single RAW copy on Google Photos), and I use Lightroom for all actual editing and tagging since it applies to the authoritative library.

I'm doing something similar, but just backing up to CrashPlan (which has a flat fee for backing up). What cloud providers are you using?
And this!

> 19) Oh yes - the only way to develop is on the live server with FTP. Version control is asking if anyone is working on the file you want to edit first.
> Given physical access to a computer, you can break into it almost trivially; but you don't see people sweating about that.

Sure you do. This is why large businesses (smart ones, anyway) require employees' smartphones to be locked with a password or PIN. This is why standards like HIPAA require secure data to be encrypted at rest. This is why laptops being stolen from government agencies leads to things like millions of confidential records disclosed (true story).

And you're still missing my point: that the likes of Toyota and Ford are relying on their wireless systems being secure. That's reckless, since now their wireless systems are the single point of security failure. The lack of even basic safeguards, access levels, etc. should a breach occur is the point of this article, more so than the specific UConnect breach. Having only one layer between "secure" and "pwned" is by no measure a good idea.
Even if it only took them 100 years to get to a star system 5 ly away, I would be amazed and impressed by a society that would be okay with investing in and working on at minimum a 105 year mission. Perhaps they live much much longer than we do :)
Winnipeg of all places! How did that happen?
Financial transactions are not necessarily "very high privacy" in the U.S. Financial transactions over $10,000 are required to be reported to the government, as well as transactions that a banker believes are part of a cumulative transaction over $10,000.

https://en.wikipedia.org/wiki/Bank_Secrecy_Act

In addition, banks are not allowed to open accounts without verifying the customer's identity.

https://en.wikipedia.org/wiki/Know_your_customer

I don't think it's clear how well credit card transaction data is protected against subpoenas, and there is a rumor that one or more of the many undisclosed §215 bulk collection programs relate to financial transactions. There are statutory protections for financial transaction records, but the Supreme Court has held that a bank account holder has no constitutional expectation of privacy in the bank's records. U.S. v. Miller, 425 U.S. 435 (1976).
Visualizing Battle Data from the War of the Five Kings
From what I've heard from the official inquiry into it the fire system design was fine for the original plan. But then they pushed massive changes (original design had 2 stories of arrivals area below 2 stories of departure areas (or the other way round, not sure), they then changed that to a sandwich of arrival/departure/arrival/departure), and as the article notes didn't give time to let the architects actually do a redesign of all components. From that point on no full plan existed and people drafted up local redesigns as they became necessary, often not talking enough to other groups or missing the entire picture.

IMHO it is a great example for structural failure of the organisation running it, being set up in a way that it couldn't properly communicate or force it's leadership to deal with problems. There even are reports that banks that had been asked to provide guarantees declined to do so after reviewing the management structure, because they thought it would be unable to react to problems properly.
I considered a NAS, but I had a Linux server already, so I just upgraded it with 6 4TB drives and installed ZFS [0]. I'm using raidz2, which is doubly redundant like RAID-6. For long-term backup I just got a BD-R drive with M-Disc support [1]; haven't tried it yet.

This still makes more sense to me than trying to store it all in the cloud.

[0] http://zfsonlinux.org/
[1] http://www.mdisc.com/
Fully patched Internet Explorer menaced by a whopping 4 code-execution bugs
I agree with you there but to this point at least, I haven't seen another good way to handle this with something like Heroku. It does show in the Gemfile.lock though (just verified).

Looking around I did just find a buildpack that tries to solve the problem. That doesn't really apply when using your service on my own servers though.

https://github.com/siassaj/heroku-buildpack-git-deploy-keys

I guess the bigger question is simply, are you going to limit your audience only to people already following best practices?

An SSL when transferring over these files, just based on the rest of the responses in this thread, would seem to make a lot of people feel better about the service.
F**k Equity: What I’m Looking for When I’m Looking for a Co-Founder
You can explore the whole dataset here: http://popily.com/explore/source/game-of-thrones-battles/

And visit its GitHub page here: https://github.com/chrisalbon/war_of_the_five_kings_dataset
When you have 1.6 billion users, every time you waste 5 minutes of their time installing updates and rebooting, that wastes 190 human lifetimes worth of man-hours. I know that Microsoft does not properly account for this when deciding how much effort to allocate to making updates less intrusive.
I agree that they're not a competitor, but they are highly complementary. It could be that the sourcing that makes this model possible is taken straight from Toptal (and if so, great way to capitalize).
My tables are partitioned daily and I still have had issues. The problem is they all still need vacuumed but at least the individual table vacuums are shorter and it makes it easier to drop older data.
Towards standarized experiments in human robot interactions
DIA was built far out specifically for noise and expansion -- with the understanding/hope that the city would never get particularly close to it.

The big mistake was not connecting it to the city's light rail sooner.
In the late 80s I flew from Santiago, Chile to Antofagasta on a quite nice LAN Chile 737. There were about 10 passengers. One of the best flights I've ever been on. I'm not sure what the need was to the government to keep that flight going or if it's still like that.
In the article they mention that Kepler-438b is likely subject to extreme solar radiation during flares because it's so close to its star. That would make it poor candidate despite scoring high on the ESI scale.
Or they would be engineered with huge advantages against an ecosystem which had never adapted defenses to them (typical of successful invasive species on Earth), and work on timescales much faster than typical evolutionary ones. These would basically be microscopic von Neumann probes, presumably with some kind of self-organizing emergent AI to direct their progress, not just spraying random bacteria everywhere and hoping for the best.
So 5mbps is 625KBps or 0.000000625 TB per second.

50 TB / 0.000000625 TBps = 80000000 seconds = 925.92 days

AWS Import can probably import at 100MBps or ~6 days.
You wouldn't try to make a 1400-ly trip, and you would try for a much faster departure than NH did.

There are about 10 stars we know about within 11-ly of earth. A serious attempt to reach one would involve doing slingshots around many bodies in the solar system, probably culminating with a dive to the Sun in order where the major rockets would be fired. (The Oberth effect says you get the most ∆v boost at the point closest to the orbiting body. You cannot logically use the Sun as a passive slingshot because you are trying to leave the solar system.) Getting the speed to 1% of c this way looks entirely reasonable, which gives about a century of travel time.

It would be very expensive, but in a few more centuries society will be a lot richer. This is also something that would only occur after significant colonization within the solar system, and mapping of distant star systems to find good candidate systems.
With 1GB of ram there are no problems running 64bit linux? I thought you needed 4+.
Eh, it's really not such a big deal. Maintaining 7% in a round for 20% total only lets YC buy 1.4%. As sama said elsewhere, the difference between 20% and 18.6% (with an equivalent reduction in their $ invested) shouldn't change much for a serious VC.

Given YC's history and reputation of being very supportive of founders, any founding team is also probably better off with YC taking a cut in a round that would otherwise go to another investor, especially given that the list of investors who are as founder-friendly as YC is pretty short.
How embarassing. I think it's hubris at this point that keeps Internet Explorer alive. I think it's been obvious for years that Microsoft just doesn't have the engineering talent to make a decent browser. It's time they bow out of that particular arena and focus on areas where they are strong.
The thing that has potentially changed (if they can really pull it off) is the ability to get a reliable quote for any particular project in a few minutes. Any technical manager can duplicate the process of building out a project plan and lining up the cheap resources to get it done (and recruiting from schools or whatever), but being able to scope a project reliably, let alone estimate its cost, basically on the fly is a real challenge. If they've actually solved that, then this is awesome. If not, then it's probably just the same as paying someone to use ODesk (or Upwork or whatever they call it now) for you.
When I last visited Berlin, I heard a joke about the airport's problems that I thought was very funny:

"Niemand hat die Absicht, einen Flughafen zu errichten!"

('Nobody has the intention to build an airport!')

Context: https://en.wikipedia.org/wiki/Berlin_Wall#Construction_begin...
Even Chrome with it's "updating automatically and completely silently" needs restarting occasionally. It nagged me to do it just now.
Not if you board a spaceship and travel to them at close to light speed! Then you, personally, would just wait a few hours.
The zeroes problem (which was mostly caused by applications not using fsync when they should) was fixed in 2007.

http://www.xfs.org/index.php/XFS_FAQ#Q:_Why_do_I_see_binary_...

Also, there's xfs_repair(8).
We were so cold last winter that we had to create our own virtual escape plan ;)

Just happens to be where we're from, and it's actually a great city to live in with a very vibrant arts and indie dev community.
How does pricing work? I imagine you can estimate the difficulty of a metabolic engineering task up front, but it obviously has a tendency towards unexpected difficulties. Do customers ask for a very well defined phenotype ("makes >1g/l/hr paclitaxel", "expresses gfp in >1ppm arsenate across a wide range of ph, osmolarity") or do they ask for more well defined things like stable lines expressing some gene?
I'm kinda up in the air about how to display the images I've sorted and edited the set down to something reasonable. I was a photo editor at my college paper and each event gets one photo you get practice cutting down the photo sets.

I send some to flickr, some google+ and so on. I need a more consistent strategy.

I uploaded to google plus a couple months back and it asked to create a "story". I really like the presentation of photos. Google makes it hard to link and share but the results for a group of photos are good.

The example:

https://plus.google.com/115477748015409107850/stories/4b3ddf...

Same link, differnt url. (sigh... google)

https://plus.google.com/+AramComjean/posts/ig1cSZAvt9Q
And, in the case of websites, _almost always shared with the copyright holders' permission_.
Maybe?!
Brand new ​Chrome 44 release added a bug
Personally I'm not sure there are any, at least as things stand today.

However, I'm fairly convinced that future systems are not going to be powerful monolithic systems but instead large collections of low-power cooperative compute units. It's not a huge stretch to claim that these exercises are worthwhile efforts to learn how to best exploit future hardware architectures on hardware that exists and is available for purchase today.

I certainly would be happier, assuming limitations like the interconnect fabric were well solved, if a common unit of compute quanta was more along the lines of a €50-99, 10-15 watt, board rather than €1-2K, 1-1.5k watt, server.
Human and A.I. = Your Digital Future
marriage is a religious institution, seems pretty clear.

That's the issue, there is no single definition. Firstly, the practical issues of every religion having different views on marriage that may be incompatible with municipal law. Further, in many countries the religious institution of marriage is purely symbolic and not legally binding. There is a wholly separate category of civil marriage, which is often intertwined with things like contract law and tax law, meaning that the denial of it to certain groups can be construed as discriminatory. Once the state is involved, many bets are off. Furthermore, some jurisdictions have so called "common law marriage" clauses that allow for circumstances indirect to religious or civil marriage, such as a domestic partnership, to be considered legally binding marriages.

I generally support having marriage be privatized and simply be a contract set by N parties that is arbitrated by courts, but your presentation omits crucial details. Moreover, whether the ideal marriage privatization is even feasible under the current disparate laws remains an open question.
My Dad had a Vector in the 80s - learned a lot from it. It had a big reset button on the front, which instantly booted into the "monitor" - a program which let you inspect and disassemble RAM. (RAM was not erased in the reboot.)

You could, of course use the monitor to disassemble the monitor, which was a good way to learn assembly language.

Later I wired an Atari joystick to the machine - it had some kind of GPIO pins. It was a very hackable platform, with S100 slots, tons of space inside, and lots of DSUB cutouts on the rear panel.

Wrote several video games in Z80 for that machine, although graphics were limited to TRS-80 style 6-pixels-per-character.

Later I found out that Disney Imagineering built a loudspeaker monitoring multiplexer around a similar S100 computer. It allowed a sound technician to remotely choose an amp output to monitor. I wonder how many other cool applications these machines enabled.
Interesting; maybe Epson's turning around a bit.

Last I checked, I still need a proprietary driver for the Epson WorkForce printer my grandparents use for color printing (alongside the HP Laserjet 1320n I gave them for greyscale). Then again, some vendors will be hit-and-miss when it comes to out-of-the-box driver support (my Konica-Minolta color laser is one such example), and I guess Epsons are in that category.
So, does this affect Windows 10 and the new Edge web browser?
I've heard around the Boston scene that you guys have started firing or are about to fire a number of your employees as part of this funding round. Any truth or just mistaken rumors?
by the time our today's signal reaches that planet, we ourselves will already be there to listen to it :)
"I have yet to be in any city where there aren't people just like you who are just looking for people to build cool stuff with."

Try coming to my city :/
From their article:

"Additionally we had been running with far too much delay in vacuuming which meant lower load on the system, but more idle time in maintenance."

So, vacuum wasn't given the resources to keep up with their load, and it's not clear if they were supplementing with manual vacuums during quiet times. Nor was it clear when they started reacting, as PostgreSQL (also outlined in their documentation link), will start squawking about wraparound well before it shuts down, or the monitoring they had in place for whether or not autovacuum/vacuum was keeping up with the workload, or the number of locks their application was taking (locks can block autovacuum).

Adjusting the autovacuum settings by table will give you finer control over the postgresql.conf parameters to better match the workload for specific tables, as well.

Partitioning would have also helped make the actively written part of the table smaller, and older data could be vacuumed with VACUUM FREEZE, or deleted later. There are extensions to help make that easier.

https://github.com/keithf4/pg_partman

Josh Berkus of PgExperts has some great advice here:

https://dba.stackexchange.com/questions/21068/aggressive-aut...

So does Jim Nasby, here:

http://bluetreble.com/2014/10/postgres-mvcc-and-a-look-at-va...

Regarding monitoring, check_postgres.pl would give them an idea that their vacuuming settings needed adjustment sooner, or their application locking needed to be adjusted to not block autovacuum.

https://bucardo.org/check_postgres/check_postgres.pl.html#tx...

https://bucardo.org/check_postgres/check_postgres.pl.html#la...

https://bucardo.org/check_postgres/check_postgres.pl.html#lo...

It's easy to mention things after the fact, though, and it's good they got things up and running again for their customers.
I'm using CrashPlan, along with Amazon Glacier storage via Arq (also mentioned in the article, though it sounds like Paul was regularly accessing photos from Glacier whereas I never plan to access except in a restore scenario).
Walmart Crashes and Amazon Crawls: Metrics and Insights
Holacracy, Explained: An Illustrated Guide to Management-Free Organizations
This is a ludicrous reduction of the point McKenna was making. You're acting like he didn't directly address this fallacy. Go read The Invisible Landscape, listen to one of the lectures that covers this material (such as Eros and the Eschaton and / or his address to the Jung Society), and then address the whole of what he was saying.

If you don't think that human neurochemistry is astonishing, I think that's weird. But don't sit here and straw man his research; that doesn't help anyone.
Website for young people, all the funny stories from social networks and life
Always good to know what is happening under the covers... https://www.pgcon.org/2015/schedule/events/829.en.html
https://www.youtube.com/watch?v=b1fcvkl0ffQ
Only a tiny fraction of species end up as invasive, because the local ecosystem tends to be better adapted. As to ‘grey goo’ there is fairly good evidence that’s far less possible than you might think.

If you don’t stick with Hydrogen Carbon Nitrogen Oxygen you’re going to have a much harder time finding what you need to grow on earth. For extra solar stuff even those might be hard to find.

If you do stick with HCNO it's hard to get a leg up on nature without simply making a few minor improvements which has limited value outside specific situations. There are also a lot of tradeoffs with binding energy etc.
The grass is always greener on the other side of the frozen, windswept tundra.
Thanks, that's very kind!

Just one correction, we're both technical co-founders :)

In fact, I'm the one wearing the sales bizdev hat today.

- Max, one of the two technical co-founders of appCanary
Well, Germany does not need to, as it has a balanced budget:

http://www.wsj.com/articles/german-government-achieves-balan...
Google's Project Zero team has written some good blog posts on this topic if you want to read more:

http://googleprojectzero.blogspot.com/2015/06/what-is-good-m...

http://googleprojectzero.blogspot.com/2015/06/dude-wheres-my...
I assume he's talking about their Rational suite: https://www.ibm.com/software/rational
Fasting/roaming half-naked in streets are cheap tools/tricks used by Gandhi to INSULT (not defeat) British;

British generosity?

Otherwise in Independent India protesters are thrashed/thrown in jail;
I'm collaborating with folks from Continuum, they are awesome! Congrats!
Anyone watching “Mr. Robot”?
Any other HNers out there watching USA Network's new hacker-themed drama series "Mr. Robot"?

http://www.usanetwork.com/mrrobot

If so, what do you think? I've been enjoying it so far -- so much in fact that I feel like it might be cool to have a weekly thread here to discuss new episodes, if there's enough others watching to make such a thread worthwhile...
This is really a matter of architecting your database correctly. In all the years I used PostgreSQL for write-heavy and delete-heavy loads, I never had a problem with vacuum but I also understood how the database worked internally and how to design my data models to best fit that when performance mattered. Same thing for other database engines. If you can make it fast on MySQL, it just means you are doing it wrong on PostgreSQL.

There is not a database in existence that allows you to be oblivious to the underlying organization while still giving good write/delete performance. PostgreSQL is no different in that regard.
I can't think of a time when using my Mac that this has been an issue. I frequently have Preview and Quicktime open but without documents as well. Same goes for Firefox being there, but not with a current window.
That's true; however Chrome restarts in a couple of seconds and restores most of your state. Also, all of the work of installing the update is done before it prompts you to do anything. None of that is true for Windows.
Happened to see your children's book in your profile; thanks for that!

http://amzn.com/B00QL616IC
RCE stands for Remote Code Execution
Sheesh. I can't believe after 6000 years TCP is still in use.