skysight-inc/HackerNews huggingface dataset:
If I've understood you correctly, you're saying that when designing a distributed system, (1) non-defective database(s) and queue(s) have some degree of fault tolerance, which we can assume for argument's sake is the same (whatever we can do to make our database reliable we can do to make our queue reliable), and (2) whichever fails - database or queue - the resolution is the same in both?

If this understanding is correct, the point of contention is #2.

Scenario | Untracked | Tracked |
Queue data loss | (A) | (B) |
Database loss | (C) | (C) |

(A) we can't replay events from database to queue

(B) we can replay events from database;

(C) we have to restore from backup

Obviously the two scenarios are indeed the same if we lose the database (C). But when it comes to losing the queue, if we're tracking what we've put on the queue and whether we've received an acknowledgement or not, we can easily replay events to that queue (B). If we didn't track what we put on the queue, how do you recover in (A)?

As I see it, the database represents a consistent view of the application state and data -- e.g. "payment 123 was settled". If you lose your database, you have to restore, then move upstream and replay events there (if possible). Downstream systems handle duplicates in replay scenarios by discarding them. This is a nice straightforward way to recover. If you lose your queue, it's not an issue, because the queue is just a channel and you replay events over it. What's important is your higher-level protocol across the channel.

In my mind the pattern is: S -> channel -> R. Channel can be a brokered queue, a brokerless standalone queue, async IPC, a thread delivering messages ala ZMQ, a file, a web API, raw UDP, whatever, but either way its the same pattern -- S tracks its sending state, it doesn't trust the channel because if things break you don't have a consistent view of your downstream obligations that you can recover from. The channel's job is to deal with delivery, but it can't address higher-level concerns across the channel.

We put messages onto queues as part of a higher level abstraction -- we use TCP/IP, for instance, as part of an HTTP conversation: if a web browser sends a GET and doesn't get a response, it doesn't just sit waiting forever hoping the TCP/IP stack will figure things out... It recovers and maybe even retries but warns you about the problem so that you notice you typed the wrong IP address in and fix it. TCP/IP is a nice unreliable example, but whatever your channel is, it's going to be unreliable, so in our business applications we need a business-case specific protocol to record our business transactional state as well to handle the failures. If you offload that obligation to the channel, you're stuffed because the channel can't understand your business case and consequently how will you recover?

Unless you mean you can design systems with a degree of fault tolerance so great that its not worth considering failures? That can't be right, what am I missing?
There are several existing services that aggregate and visualize fitness and health data, for people who are too lazy to build their own site :-) I'll plug mine here: https://zenobase.com/
I did two cups in my Fagor Duo last night at 25 minutes - they turned out great.
Pen and Paper Pirates
I understand! In the mean time, I opened ticket 464188 with some suggestions.
In regards to your comment about 'this will optimize X,' it reminded me of article [0] I read recently. The main point of it is to 'beware the local maxima.' Governments seem to focus on one goal at a time, the X, and seem to disregard effect to other variables: they care only about the local maxima.

[0]: http://www.iafrikan.com/2014/07/07/beware-the-local-maxima-p...
Is descending further down towards the bottom of the barrel to leech on more publicly available, easily harvested and/or less scarce items to sell at a markup a rising startup trend? It seems building novel value into a product is becoming less important to a segment of the startup industry. We now have selling of public parking spots, dinner reservations, and now email addresses. And while this model isn't new, there appears to be a popular reemergence of it.
That's the problem. Wealth people improve a city, which makes it a more desirable place to live which drives up cost of living, which drives out the poor people that lived there before.
I was about to post the same comment as the GP. I thought this was per month, and was going to say it was horribly overpriced. Now it's not :P
Lobbyists lobby. All that means is that they share their opinions with government officials. Money need not be involved. When people complain about lobbying it's usually in the context of corporate-sponsored lobbyists who are paid to push their agenda and are spending money. Money can't be paid as an outright bribe (I'm sure it happens, but is pretty rare) but rather in the form of campaign contributions, or occasionally in direct political advertising. Recent Supreme Court rulings have really removed any restrictions on how much can be spent by independent political groups even if they are 100% sponsored by corporations or trade groups or whoever. Wheeler is an appointed leader of an executive branch agency, meaning that he has no campaign fund. Funds can be directed to Congressional campaign funds and Congress can in turn put pressure on his agency (the FCC) to either defund them or rewrite their authority, or to sue them for whatever perceived breach of their existing authority. Theoretically, there is no way a lobbyist can directly influence him.
Vandalism is vandalism, regardless where it comes from. There should be no need to discriminate editors on the basis of their profession or IP. Only the nature of their edits should matter.
"It's evil because it's using police state methodology of treating everyone as potential criminal and employing presumption of guilt"

Isn't that what you're doing when you lock your doors though?
I apologize. Thanks for the explanation.

Just gave the HN guidelines a thorough (and much needed) read.
That's an excellent idea; I wonder why they don't do a family sharing plan.

Do you think that the sharing would significantly impact the overall number of subscribers? Obviously you're of the opinion that the price point could be raised to compensate, but I'm not even sure the overall number would drop a significant percent.
From the little research I've done, it looks like the bifidobacterium genus, in particular certain strains of bifidobacterium longum [0,1] and infantis [2], have favorable effects on IBS and anxiety. Interestingly, in [1] they noted that it was able to normalize low BDNF levels, which is one hypothesis as to how SSRIs treat anxiety and depression.

However, I picked out my probiotic specifically because it has those species (among many others), and you read what happened.

[0] http://www.ncbi.nlm.nih.gov/pubmed/17172187

[1] http://www.apa.org/monitor/2012/09/gut-feeling.aspx

[2] http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2886445/
San Francisco Bay Area, (NO REMOTE)
Take-Two Interactive a leading developer, marketer and publisher of interactive entertainment for consumers around the globe. The Company develops and publishes products through its two wholly-owned labels Rockstar Games and 2K. www.take2games.com/careers or leo.rosa@take2games.com

Site Reliability Engineer
===== What You'll Do ===== • The Site Reliability Engineer will be responsible for architecting and troubleshooting public facing Linux web architectures in various hosting environments including database technologies (traditional and emerging). • Along with the Online Engineering team, he/she will work closely with development teams to develop, deploy, and support applications. • Work with development groups to architect solutions for new and existing projects • Utilize configuration management and custom scripts to deploy and manage systems • Ensure all critical systems and services are properly monitored with relevant alerts enabled • Manage backups including ongoing policy refinement • Migrate applications off of legacy environments with minimal downtime • Be able to respond to critical requests during off hours

===== What We’re Looking For ===== • Mastery of Linux (RHEL/Centos preferred) support experience in large scale environments. • Advanced knowledge (maintaining, troubleshooting, tuning) of web architecture and related applications including the following: Apache 2.x; Memcached; PHP, Python; MySQL; Mongo, Postfix, DNS; CDN; SVN, GIT • Advanced knowledge and experience creating and executing shell scripts • Advanced knowledge of load balancing administration and tuning – BigIP LTM, Squid, Nginx, Varnish • The ideal candidate will be comfortable in “non-silo’d” environments and have an appetite to research, test, and implement new technologies.
The unknown knowns -> qualia. I am doing some work on the application of these concepts in organisational design and control.
If you're really interested in hearing someone, why not reduce the barriers to having them come speak? And if you're not interested, why let them speak at all?
Word. I'll note for others that impressing a journo involves not looking up their most recent clips and figuring our how your topic is like those too, but rather understanding the needs of that particular writer in their particular beat and trying to add value for her while extracting some value of your own as well.
You should look at Scala. It really feels like the best of both worlds: strong, statically typed without the boilerplate.

Scala is what I was looking for when I found Groovy.
I got the same error on Chrome on Windows. None of the videos work.
I must be doing a really bad job of writing, because you're not addressing the point I was trying to make at all.

I'm ok with paying $100 for internet access (well, not really, but still). If $100 cannot get me internet access at the advertised speeds, I'm ok with paying 120, or whatever additional cost per GB.

What I'm not ok with, is if $100 doesn't do it, Verizon goes out and shakes down the companies I do business with on the internet connection that I ostensibly paid for, who then raise their prices (gotta pay the bills) for reasons I don't understand. I'm still going to pay, there's no such thing as a free lunch. And not only does this obscure information about the real cost of my connection and the services I use (and that does matter), not only does it open the door to all kinds of anti-competitive practices around who gets the best deal with comcast/verizon, it's guaranteed to be less efficient than just upgrading the network and charging me for what it costs. Now I'm paying for all the hotel rooms and buffet spreads that went into that deal being struck? In addition to the cost of the fiber? Just build the fiber, and charge the customer (me) for it.
I'd rather not, I take your word for it.
"Rather than design master plans, we designers of systems should instead design federations of little systems linked together by extensible protocols and generic interfaces. This way we can create complex systems without having to explicitly define them. These protocols and interfaces themselves are systems which, in order to work, must constrain what can be said."

I'd be very interested to see a companion piece that investigates specific working examples of this approach. Most importantly, I'd like to see examples of systems of this kind that can actually be attributed to a single person or small group.
Spam filters have gotten very good.
> My initial idea was that it would be possible to store data to be written at RAM at first, and periodically flush to hard drive / DB.

Sure, but you lose anything that isn't written to disk. IIRC you can set up Mongo and Redis to do this (I'm not familiar with many of the other options). At this point you're no longer an ACID database.

Most DBs will cache as much as they possibly can in memory. Often index's will take priority, but rows that are being accessed fairly frequently will also be in their cache. Obviously the details are different per db and configuration, but in general, it gets cached.

Also, when you fwrite your data actually sits in RAM for a bit before being written to disk. Databases and other applications that actually require data to be on the disk right now need to call fsync.

(Aside, even then you're disk can and will store writes in it's own internal buffer before it can be written to disk. The OS doesn't have much control over this.)

A lot of people will, to avoid having to spin up db replicas, cache rows in redis or memcache and use those for reads whenever possible. It has its advantages and disadvantages, but for pk-based reads you can decrease the number of operations your DB needs to do at once (allowing it, for example, to focus on writes.
Native iOS Apps Written in JavaScript
I'm not a fan of this approach. Why did you build new, proprietary software instead of adding that feature to reprepo, for example? Why is packagecloud.io not giving back to the open source community when it's based on packaging tools developed for open source software? The fact that your software is proprietary means when you disappear, so does my infrastructure. I certainly don't like giving up basic user freedoms in the area of software packages, which has historically been open source.

Edit: to be less snarky
Good call - that was a vague statement - I've refined it a bit: "Food is one of the few true necessities in life, yet alternatives to junk food and eating out are often overlooked in mainstream thought." At least closer to what I mean, anyway. Thanks for checking out.
I'm making the transition to vim as well. My wish list was similar to yours. But I've decided to adapt my expectations to be a better fit with how vim works. In many editors, a tab and a file are equivalent. In vim, you have buffers (in-memory representations of a file being edited), windows (views on a buffer) and tabs (sets of windows). Since in vim a tab is not a file, trying to make that file-per-tab model work may be possible but seems to lead to several pain points.

I'm using the Command-T plugin to navigate the file system (to open files) and to change between opened files (i.e. buffers). I usually work on a single tab, splitting windows when needed, and alternating between buffers with ",b" (Command-T to show current buffers and select one) or "]b" (next buffer).

If I need to work in two different window layouts, I can open a separate tab. That is rare, though.

Additionally, I'm using the Ag plugin to search in files and the qargs plugin to replace text in the searched files.
First, it's great to hear taking the SSRI helped!

Regarding the diagnosis of IBS, What I'm saying is, I've yet to have had (or seen) a test that definitively states "yes, you have IBS".

During my time with stomach issues I've been tested for UC, Crohns disease, Celiac disease and gluten sensitivity. All the bloodwork and whatever else came back with definitive nos.

Once all of those were ruled out, then the diagnosis became "IBS". Meaning, I didn't take a test that said I had IBS, I was symptomatic and all the actual tests they could run were negative, and hence, I had IBS by default.

What that meant to me was, something is wrong, they just don't know what it is, I should keep searching and trying things to figure out what they don't understand.

I've read so many posts where people get diagnosed with IBS, take the prescribed drugs, and just suffer for the rest of their lives. I just want people to understand they should feel empowered not to settle for the IBS diagnosis and explore options to try and solve the issue for themselves (like you did via SSRI).
As I understand it, laying pipe is the fundamentally high cost of expanding or rebuilding a network. The cable itself has a non-negligible cost, but getting zoning and town permissions, securing land for junction cabinets, and digging through existing roads and around existing utilities is hugely expensive.

What I don't understand is why any new neighborhood could be built without such underground conduit in place. If they're going in for water, sewer, power, etc. then it should be trivial to pop in an additional tube for "future connections."
After trying both ways, I find that types help a lot, helping me write correct code faster and modify the codebase with greater confidence. Currently I'm using Scala which I believe provides a good mix of expressiveness and type safety.
Birthday Word Clock
> I find it a shame that smart people like silly things

Why? I don't see how this matters at all. Besides, possibly, disrupting your vision for society
No problems on an ubuntu 14.04 with chromium
Shouldn't we play fair with them? Although you can use that link to download it (yep, it works), where is the point to don't keep it to ourselves?

Heck, I understand we all want to see when we want because we have better things to do now or not enough time. Regardless, I don't think we should ruin from starters their commercial project.

I mean, it's not even a DRM. Just a weak misleading protection layer from Vimeo for deterring little noobs that don't know how to use their browser's debug console.

Let's give the creators some advantage before gaming the system.
COO, particularly if the company has fewer than 10 employees.
Anything you've written or read on this topic you'd recommend?
Its more than that. This study does not isolate based on knowledge or know how as in 'people who actually know answer to an objective question'. This study isolates based on influence of 'social' stimulus.
Your question implies that SaaS is the assumed/"normal"/"natural" way to go when developing software, which is basically the circle jerk I was referring to - if it isn't a format locked system your customers have 0 control over or visibility into, it isn't worth doing?
How about this. The speed rating that you advertise for your cable modem (or dsl) service should be the slowest download rate on the last mile. In other words if the best I can get is 10mbps from the MSO headend and netflix should be able to prove this then that is what should be advertised. Consumers should get money back when customer service fails.
I find working for corporations really relaxing. You just need to show up, code some stuff at glacial pace with plenty of time for writing tests and code reviews and messing with environments that always fall apart and slow hardware and cumbersome security theatre, and ridiculously wasteful management process because managers have only vague idea what is to be done and no idea how to manage and delegate their inaptitude to developer team leaders.

And this feeling that project will fail or succeed mostly regardless of your effort and probably without effect on your compensation. Worst they can do is fire you and that will probably mean for you just getting a raise.

No one expects miracles of you and if enyone does no one is expecting that you'll actually deliver.

This is so relaxing in contrast where each hour of your time is the thing you sell and often you have to wrestle your money from the client who overestimated profitability of his phantasy. Where your projects and you actually rely on you delivering miracles.
Fashion Photographer Felix Krueger
All his books--including Lolita--should be required reading
in high school and college. His writing just flows. I remember a college professor who wanted his class to read
Lolita, but was told if he wanted to reach ten year--he would be wise to just let it go. Maybe things have changed?
After college, I don't think I would have ever picked up another book of fiction, until I discovered Vladimir Nabokov.
They use the data for pricing I believe.
Eric Schmidt email confirming Google’s 1hr window to counter Facebook job offers
One disadvantage of the Windows system is, as far as I understand it, that, once relocation happens the libraries can't be shared in memory anymore. This defeats the purpose of a shared object somewhat.

After the loader patched in the new addresses the pages making up the library contain different data for multiple copies of your library, and differ from the data in the PE file. So the PE file can't simply be mmaped and the same pages can't be used by different processes.

I'm not saying this is a big issue, but I think it's a difference worth mentioning.
What would a better Tech eco system look like?

Prototype manufacturing plants need a source of material having to fly things in automatically makes them more expensive.

Software companies need engineers but engineers typically go to where the jobs are. So until there are jobs, there are few engineers.

Infrastructure companies need startup companies that are being created to keep the gear around so that they can help build infrastructure.

Entrepreneurs need a source of capital that understands both the opportunity and the risks. They need banks that also understand the opportunity and the risks.

What is the current connectivity solution for Maui? Is there 10gbit connectivity back to the mainland? At what cost per Mb? Any local data centers?

What are the minimum taxes on a business in Hawaii? What are the minimum compliance regulations?

Is there an advocacy group, something like the Chamber of Commerce which has a whitepaper (should have answers to some of these questions in it)
This is just an email list? A more compelling product would connect a particular journalist with every story they've ever written, across all publications he/she's ever worked at. Then you could search articles by topic, type of product covered, sentiment towards particular vertical...etc and reach out only to the journalist that seem to have an interest in whatever story you're pitching.
Sounds fair enough for a junior to intermediate job. After 5 years I would guess the OP is an intermediate programmer.
Craft Your Code and Collaborate Anywhere with NitrousIO on OpenShift
This sucks.....luckily we can fork the library legally.
Fair enough, thanks anigbrowl!

I can definetly understand finding people is easier than paying them. I guess I didn't really factor the economy and indie movie scene into my response.

Experience never hurts - so long as you learn from it (and it is benifical to you (eg. connections and favors; as you pointed out)
This is a nice result. I'm sure a lot of people had this particular idea but never got to actually do it. Not surprising because this is actually why to human brain scales so well. This was also hinted by AutoEncoders where pieces of a net are built separately bottom-up. I'm guessing a final settling phase would also be useful here.

One unfortunate thing is that different runs will produce different nets. But if training is radically faster and accuracy differences are small than this is one new technique to add to the toolbox.
'Another World' May Not Play So Great, But It Still Looks Incredible
If your printer was capable of handling the sheet, you could in theory print one card (in position 0), and then at some future point flip the stack of card sheets over and print a new one in the opposite corner (just rotate the sheet so "position 0" is a card and the cutout is position "max"). Cheap. :)
>It is as if mathematicians would start with axioms. You do not start with axioms - you start with proofs. Only when you have found a bunch of related proofs, can you come up with axioms. You end with axioms.

This makes no sense. When you write a proof, you're already using axioms, you don't come up with them afterwards. Mathematicians usually start with conjectures, then either proves them or shows them to be undecidable and can be used as an axiom.
They hired me, so yes, they did. I have a B.A. in econ and fine arts (drawing and sculpture) with a masters in Software Engineering from a no name school in Minnesota.
try freelancer.com there are millions of php projects, sometimes they hire for the long term projects, and there is more like freelancer.com like odesk.com elance.com etc...
basically this is saying the entire story is pretty much bunk. Its more than a significant omission, it invalidates the entire analysis presented.