skysight-inc/HackerNews huggingface dataset:
Google for nginx, Cassandra, memcache, node.js, RabbitMQ, and visit highscalability.com. I'm sure folks will chime in with some other useful nouns and urls.

Highscalability.com has links to videos and articles of several major sites and their architecture.

The youtube video was quite informative.

On to the schema...without knowing your specifics, I would say to map your entities in a normalized form, but, you will most likely bust most of them out and denormalize as influenced by your display page (view) or particular portions of it.

Also play around with Amazon AWS. You can play around for several dollars an hour without having to invest in your own hardware.

Also, lurk around stackoverflow.com
Measuring the Popularity of Social Media Platforms Across the Web
Minor correction: I meant to say "broken down by the digestive system" with regards to administering proteins orally.
The designs are each unique enough that I wouldn't call them iterations or tweaking, but exploration of different ideas, which — especially for mockups — is normal in design.
"hipmunk" (I really hate domain squatters if this is best URL you guys could find available?) looks good, but I wonder if it's all flash 'agony' and name recognition (hey you got cnn to write an article already, sweet hook up!). As far as I can tell it has a pretty 'info graphic' interface, but doesn't really do the thing that would get me to use it: save money on flights.

Does hipmunk do anything different? It doesn't look like it can tap into sabre, ryan air db, etc, looks like it just scrapes and organizes, nor does it look like it has any fancy back end db of extensive flight info with a smart heuristics engine to predict future prices. So, beyond help those who have trouble visualizing a schedule, I'm not sure how this is any better than farecast et all. Can hipmunk predict if a particular flight's price (not willy nilly flights, I'm looking at you farecast) will go up or down?
Quite interesting. As a developer, one thing that has frustrated me to no end is product managers not interacting enough with the developers. In my corporate career, I have seen too many of them talking abstractly about the product and hoping that the developers will magically figure out what needs to be done. After handing over a sketchy PRD, the job is done. " Drafting functional specs that range from whiteboard drawings to many-paged docs describing how things will work (totally depends on your ability to communicate, the team you work with, etc)" - This is so important.
‘Golden Gate’ - How did it get here and why is it Orange?
Good luck with that. Barriers to professions - which includes access to research - is what keeps the professionals well paid and thus perhaps allow them to fund more research.

>>
No, Public interest in research is what keeps funding higher.

Isn't that infringement of copyrights by the way? Do you think it is fine too if I start distributing freely an application for which you have worked for years and decided to charge for?

>>
Researchers publishing papers dont earn a penny, the only thing that they get is free (no charge to researcher) dissemination. In fact a lot of researchers post a free version on there own web site.

I have published two papers in journal published by American Chemical Society and authors are allowed to put up pre-publication / non edited copy of their papers on their own website. ACS also provides a link from which upto 50 visitors can download the authors paper for free in first year and there is no limit after first year.

E.g. http://pubs.acs.org/cgi-bin/download.pl?ie0704647/P8Lu
is free link to my first paper, the article is behind the firewall but if you use above link, you can get it for free.
Christian Louboutin Boots sale, Discount
It's clear you didn't actually click on the sites in the powered by, but rather went completely on ShrinkTheWeb's out of date thumbnails. There is not a single dead link, and the image with the text is a reference to a server error, but clicking on the site goes to the live site.

There are 3 pages, with 9 live sites. There are many more, but not everybody decides to post their sites to the powered by section. We'll be starting a push to get NOLOH authors to post their sites there in the near future.

Furthermore, if you would've actually taken the time to read through our site, you would see that NOLOH does in fact render content without JS, if the developer chooses, which we're constantly improving. You can read our blog for more information.

It's somewhat shocking that this is what HN has come down to. Writing a reply without actually verifying your comment. I'm starting to think I don't belong here anymore, it's starting to feel like high school all over again.
So, this is some joke site where it sees you're logged into Hacker News, finds your userID, grabs a random one of your comments and fingers you of being the geekiest geek in geekdom, right?

...right?
Unfortunately, no one can be told what homelessness is. You have to feel it for yourself.

It's like putting on heavy weights and thick glasses because you want to know how it is to be old.

The worst part is the psychological one, imho. He can go home. All bills paid, cosy warm room, roof over his head. But to know that you "failed in life", can't provide for yourself like so many others, have nowhere to go... I guess that's the real homelessness.

I recently experienced not getting paid for several months. It's quite interesting what this does to your head.
I'm glad somebody went and did this. Fundamentally, humans structure their social relationships in terms of groups, though the groups may not have names or be disjoint, and membership may not be binary. I think you guys are on the right track.

The biggest question I have is, how do you get people into your site in the first place? I would love to use The Fridge, but if my friends don't, what's the point?
This fan-made commercial says it all:http://www.youtube.com/watch?v=OdB7GDZY3Pk&feature=youtu...

And now it's stuck in your head! ding
To the best of my knowledge, not at all.

See e.g. http://en.wikipedia.org/wiki/Florida_Central_Voter_File for details.
Apple seeking to patent spyware
"Given the unique requirement of consoles -- the system must perform exactly like the original Xbox 360"
Elektra Records Founder on YouTube, Blogs and the Future of Music [video]
If you rub coffee grounds on your face, it will look like dirt.

There was an experiment like this in the City paper in DC, many years ago.
My advice about scalability for someone at your stage is to focus on making your data model clean and well-organized. Try to avoid obvious mistakes (such as querying for the same data over and over again). Make your code as clean as you can.

If you followed this advice, you shouldn't break until dozens of dynamic pages per second. And then adding a caching layer like memcached for the most common queries should take you up into the hundreds.

At that point you need more scalability work, but should have the finances for it as well. This would be a Good Problem to have. Don't worry about it until you get there.

Incidentally the main reason to keep your data model clean is not to help scalability (though it does surprisingly well for scalability issues), but to make maintenance of your code easier. Because as your vision of the product changes, you will find your code changing. And a solid data layout will make that process easier. (The end result is never ideal. Be pragmatic in your trade-offs, but not cavalier.)
Trader Joe's, come to Colorado, you can make the long haul work, I promise.
I would have shived him for his 4g iphone while he slept on his makeshift cardboard bed under the bridge.

I'd make the shiv from a melted 3g iphone.
We Will All Become Old Men
22-year-old Mexico woman crowned Miss Universe
Exotic Flowers: Luxurious and Impressive for your Home and Garden Decor
Same here, sans the vacations.
Facebook Places & Keeping up with the Joneses
While you can change the server every second, it still has to look roughly the same to the user. If they try changing the name of the HTML elements on every page load, Rapportive just needs to detect based on position on the screen.

If they start looking at the DOM or making behavioural tests to see if Rapportive is loaded, then Rapportive just needs to make sure the browser returns the same results as when it's not loaded.

They could even run it in another process, and just position a window over the right area.

User agents (tend to) run on general purpose computers with no lock down. If you control the user agent, you win the detection war.

Lawyers are Google's own means of effectively stopping Rapportive, but the PR fallout might be interesting to watch.
Irc bot using markov chains and individual user ranking
How to Minimize Politics in Your Company
I think that's probably why Rapportive are looking at working with mail apps other than GMail.
The traditional Unix way of doing it (Makefiles) keeps the two kinds of scripts together but with separate targets, with 'build' and 'run' being common ones. That addresses some of your points, like not having to deploy every time you build (you can make 'build' your default target, and only call the others when explicitly needed), but I take it you're not a fan overall?
No, I would not. RC servos cannot follow specifically-defined trajectories, otherwise known as splines (ie. be at encoder position X at time Y), as RC servos rely on very basic (analog) position feedback.

Some of the lowest-level PR2 controllers require the specification of splines to achieve accurate motion.
David Stockman: Pimco-style crony capitalism rules
Not in any way meaning to disrespect the man, but i'm not sure which Herr Albrecht you mean, of the brothers, and we know so very little about them.

In Europe ALDI goes hand in hand with all the same complaints attributed to WalMart, often with good reason, but possibly with less scope of impact due to sharper anti-monopoly enforcement.

Actually, on very narrow lines, if you're in America, looking at Europe from a distance, ALDI (AlbrechtDiscount) = WalMart. Even the business names are in the same style :)

I wasn't aware of Trader Joe's (not living in the territory) until this discussion ~ it sounds a very cool place, way beyond the comparatively - by the sounds of things - stiff and terrifyingly expensive up-scale food outlets i see in London. (but then comparing food prices is always going to be a shock between such vastly different scale markets)

I'm actually shocked that they (Trader Joe's) offer a wage you might be able to live on in a major city. That's a model business. Just not sure about the role model thing, as that's so personal.

This is all good, but ~ not checked into this ~ presumably, like ALDI, Trader Joe's is a private company, and so we've little insight into profitability. Anyone got any intel on that? The oddest thing is why a known ruthless operator would do almost the opposite style so thoroughly. I can only put it down to the sibling dynamics where they locked each other out of territories. Hmm, maybe there's a business model in that. 1. Have twins 2. . . .
Are you pirating GNU/Linux?
I just found it amusing as a design spec requirement. Usually newer systems have to go faster and do more things. Looks like they went out of their way to develop an on chip fsb like interface to slow things down.
That is a great suggestion and we just hacked one together. When someone wants to leave the demo group (too much spam or tired of the group) anyone can leave a group in Group settings and click leave group.

Thanks for the suggestion!
I have been working through these ideas since 2007, taking it one step at a time:

2007: I "single-paged" subsections of my application, with different PHP scripts on the backend.

2008: Consolidated the backend into a single API.

2009: Switched the backend to Rails for ORM functionality, and finished upgrading the client interface to a single page application.

2009: Switched the backend to Javascript (Rhino) to enable sharing of model validations and other code (even native object extensions) with the client.

2009: Got my application working completely offline using a local SQL database and replication manager, together with ApplicationCache. At first I used LocalStorage but soon hit storage and performance limits.

2009: Switched from Rhino to NodeJS. Much faster, cleaner APIs. Huge performance gains from V8 and non-blocking IO.

2010: Results of the above up at: https://szpil.com

Along the way I built up a framework for managing concatenation, client-side navigation, sessions, views, controllers, email etc. One significant advantage of building client-side only apps that replicate with the server is that they work offline by definition. Managing state on the client opens up incredible opportunities.
How Authors Really Make Money: The Rebirth of Seth Godin
Well the invite links for each group can be reset or killed at anytime and the group owner can kick out anyone that doesn't belong at anytime.

Like i said earlier these groups are like a themed house party or potluck where you only invite your friends you know are interested in the theme and trust them to bring a good dish and not jump on the furniture.
This is a good video on the subject on YouTube.
http://www.youtube.com/watch?v=dBnniua6-oM
These are Earth-mass planets, not Earth-orbit (1 year period) planets. They need 3 transits for confirmation, which requires at least 2 years and more likely 3 years of observations.

These are "hot Earths" to the previous "hot Jupiters" we had been discovering.
At this moment it is on the list! We had a file export to download all media by post or by group which we are bringing back to include all posts.

Hopefully we don't go down before we get that up...!
You don't need to be aware of the rules. You might not even care whether or not you're breaking them.
Thanks! We have a few new site coming out soon that "polishes" this up a bit but still keeps it super simple. nothing wrong with a gradient or two?
There was a Linux update to support multi-byte encoded characters many years ago, so that default grep was suddenly much slower, and setting "LANG=C" would make grep many, many times faster, since it would work on 8-bit values only.

I'm not sure if this is still the case, or if GNU grep has now optimized this path.
Beautiful Pencil Sculptures
Great work. Don’t miss these pictures!
Trader Joe's is a boostrapper's dream: cheap, tasty and quick meals.

Their prepared foods and marinated meats are really pretty good. Their cheese and wine selections are quite good. I found a Petite Syrah I absolutely _love_ there for $3.99. We buy it by the case. Bread is consistently some of the better bread I've found outside of dedicated bakeries here in the US (our bread generally sucks). A glass of wine ($3.99 a bottle), a loaf of bread ($1.99 a baguette lasting a day or two), a bit of low fat goat's milk brie ($2.99 a round lasting several days), a bit of sliced salami ($2.99 a for 2 salami's lasting 4 meals), some dried almonds ($3.00 for a pack of 20 mini bags), and I have very tasty no-cook meals for a day or two.

If you're in Silicon Valley (or anywhere that has a Joe's), and trying to eat well on a budget visit Trader Joe's.
"traitorware"? Wow, that's not unnecessarily inflammatory at all!
It's excellent, and I'm going to use it from now on. I was hoping somebody turning up saying "we've solved this" :)
Ask HN: Any tips on finding short term consulting gigs?
Help! I'm a struggling single-founder, I've been working on my startup(s) and doing freelance web development (PHP/JS/HTML/CSS etc) since my former employer folded around a year ago. I've been able to find a steady stream of clients through friends, family and personal recommendations but I've pretty much exhausted this supply of customers and I'm starting to worry slightly. My main focus is my startup which I should be able to launch within a week or two, but there are of course no guarantees that it will succeed, or provide enough revenue to cover my living expenses, at least in the short term. So really my question is, how should I proceed from here? I have about enough money to cover my bills for the next 30 days, but that’s it and my partner is pregnant & due in October!

I’ve considered freelancing sites such as e-lance etc, but these sites take a while to establish reputation, so the route to success seems to be – spend a month or two doing lots of cheap jobs to establish reputation, then start going for the bigger fish. The problem is I’ve left it too late to pursue this route, I’ll run out of money too quickly.
Yesterday the problem really hit home, so I spent 6hrs cold calling local businesses, just asking about their current websites or lack thereof, and although I got a few leads and some moderate interest (which I’ll follow up later), I’m not entirely encouraged.

I’ve reduced my outgoings as much as possible, but after a series of property maintenance nightmares (roofs leaking, boilers breaking etc) I have to pay a substantial amount in bills each month.
I’ve considered getting a job, but senior web dev positions are few and far between in my area and I’d still struggle to cover my bills

So HN, what do you think I should do?
That is the cat and mouse problem we are trying to solve. For private networks what is the immediate value if no one is on it?

We have tried to make the sign up and group creation as simple as possible so any event or social gathering can be another use for the fridge. A crazy frat party, potluck dinner, family vacation. anything where you have a temporary social network for people to come together around, start socializing and if it dies ok. but if you make a few new relationships and create a new group or two with them that is the goal...

We know we need better tools to bring people in. But we are noticing once people are in with a few friends and groups they love our platform.
The question is what percentage of successful entrepreneurs are really concerned with living rich and how many are just after the freedom. Looking at it in terms of expected value of a startup there would be far better ways for one to focus solely on making money if that was the only goal.
Guerilla action aims to turn advertising space into public space
RIAA: U.S. copyright law 'isn't working'
I've been happy with gandi.net; I also like their DNS hosting options.
the situation got "fixed" at the second try
http://readitlaterlist.com/blog/2010/08/version-2-2-approved...
So as about a million comments on Slashdot -- about as Apple-hating a place as you'll find -- pointed out, this patent application is basically for the phone equivalent of OnStar's "someone stole my car, find it and shut it down" system, plus a couple extra features like taking a picture of the thief or detecting attempts to get through the passcode lock. The patent, if granted, will most likely be bogus, but the intent is perfectly reasonable.

Of course, reasonable things don't generate lots of pageviews and donations, so it has to be spun into some megalomaniacal complex Steve Jobs has which drives him to want to spy on you, you personally and take away all your freedoms to suit his nefarious purposes. Which is vicious lying stinking reeking bullshit FUD, which is what EFF has lately taken to using as a signature tactic, which is why I no longer donate to them.
I don't mean thumbnails. http://www.noloh.com/?poweredby/ shows me four sites and no way to navigate to more. If I follow the link to the last, http://www.diffpaste.com/, I see "Paste", "Diff", and "Latest Pastes" across the top and categories ranging from "PHP (67)" to "C++ (1)" down the right, none of which do anything at all. Likewise, http://www.noloh.com/ has several highlighted phrases and "Read More" divs which look like they were supposed to be links but don't go anywhere. Many other links all lead to http://dev.noloh.com/ rather than whichever page was intended, because the server can't see the path after the # sign. If you thought this stuff all worked without js, I'm sorry but I assure you much of it does not, so the happyworm.com crew seem to be onto something good.
A conversation about single page apps would not be complete without mentioning Sammy.JS http://code.quirkey.com/sammy/

It's a fantastic little library that gives you the ability to add what I can only describe as 'rails-style' routes to your client side .js apps. It makes your single page apps much easier to write and has a good event-handling model too.
Exactly and thanks for the feedback!

We have tried to make it super easy to start and join a Fridge. Just enter your email to create a group. To invite folks send them the group invite URL. All they have to do to join that group is click on it and enter their email and create a password. Hopefully this is a first step in making it dead simple to bring folks in to join or crate any group that needs a bit more privacy or is just a temporary network around an event so you don't have to friend people on facebook.
Canadian firms plan to try to make car from hemp
I think that what a partner should give you is moral support, not technical one. Why are you in this relationship? Because you love her or because you want someone to support in your startup? You already said that your cofounder understands the tech part. Why should your girlfriend? She is there to (hopefully) fill other parts of your life that are not work related.

I had a girlfriend last here. She was 10 years younger than me and was studying music, so she did not understand anything about math, or programming, or markets, or startups. And she needed not to. I was happy with her, she gave me the support I needed in doing my work even we did not speak about anything technical.

If I was feeling bad about something in my work, I spoke with her about what worried me and my feelings, not the technical problems I had. Girls, and especially your girlfriend, are not interested in how things work, but in how you feel. They are not interested in solving problems, but in supporting you.

Leave to your girlfriend what they are their "duties", give her the place she deserves in your life and not in your job. For tech understanding you have your cofounder, friends, fellow entrepreneurs and HN.
Mathematical crochet
Teen girls are most-common target of sextortion
I don't know about the hemp, ut what the world needs is an open source car. you know, one that works like the PC where can upgrade every subsystem as it wears out with something way better than original.

ok, so cars need a lot of integration so it probably wouldn't be a great car, but it sure would be cheaper.
A micro-manual for Lisp implemented in C
I couldn't get the line "I'm sick and tired of your kung fu treachery!" from Black Dynamite out of my head the whole time I was reading this.
Defining the right indexes is the key until you outgrow the RAM in the server. You can be crawling with one schema, define a few indexes, and suddenly be able to handle a hundred times more activity. What indexes are right depends on what queries you need to execute, not just what data's in the tables, so read up on how indexes are used by your RDBMS, not just how they're defined.
People do click those ads, if they did not google would have removed them long ago.
Answers the question: why do normal people, when they know the EFF exists at all, think it is a joke?
affiliate marketing = using $1 to make > $1. how to do it, varies from pple to pple, some use ppv, ppc, jv, etc. like @il said it...affbuzz.com is a good place to start.
Here is some more information:
http://www.spiegel.de/international/business/0,1518,708881,0...
http://www.spiegel.de/international/business/0,1518,709937,0...

Aldi is feared in Germany by their suppliers.
Once they pressured farmers to sell their milk at such low prices that the farmers went on strike and poured their milk onto the fields instead of selling it.

The working conditions seem to be average for a discounter. Meaning: Not very good but that is to be expected.
Which 10 skills do you wish to learn in your life?
Open the spreadsheet link, File / MAke a copy, and enter in 100000$. Voila: it works, you never run out of money with the 4M$.