skysight-inc/HackerNews huggingface dataset:
One way to read your comment is as a request for help, but there's no way to contact you directly from your profile here on Hacker News (in case you weren't aware, the email field is not public).

It's worth noting that some open source projects are noted for fostering a community that accomplishes what you describe... perhaps all that is lacking is the initiative to seek out such an opportunity!
The Caffeinated Coder: Is Caffeine Good or Bad?
Well it depends what language you're talking about. With C++, the preprocessor is not used as much, but with C macro use is still very important.
Did anyone understand why logging calls on only problem machine had different fsync behavior than normal machines?
I found it was more "here's what you should notice" than "here's what you should do".
Autodesk 123D: build 3d models with your iPhone camera
Ex-Tesla and NASA Engineers Make a Light Bulb That’s Smarter Than You
Python 101: How to Send SMS/MMS with Twilio
The cognitive dissonance here is striking, "the difference in price is peanuts" vs. "I won't lower my price."

How exactly did you find this compelling again?
I was there in person, and I felt the same way. Very surprising.
Thanks for the great summary, saved me time and was a great snapshot of the take aways.
So here is a simple idea. If you're going to work 80h/week anyway and you're a talented coder: source one contract job billing hourly in London and another in SF. Working out of EST you work 5AM-9PM on a 10-6 in both places -- Billing $80/hr with a good corporate setup and working 4000 hours/year you can get 320,000/year, if you have EU citizenship (potentially from one of the return countries) and US citizenship you can probably setup a decent double irish and keep about 280,000+ of that in offshore money. If you want the money in the US and are clever about it you can keep over 250,000 of that money. I suggest London and SF because the 8h timezone difference and high cost of living in both cities. But to give you an idea this is basically $2.5M after-tax locked in the time it takes to make a 10 year exit. That's 1/4 of the first example and way more than 25% of start-ups fail. Admittedly $2.5M isn't the kind of resources that lets you go after solving the biggest problems in the world, but it's pretty solid by developer standards. 1.8X is a good return for a venture capital fund and they have more favourable stock than employees or founders, so you have to think the average start-up return for founders, even enormously talented ones is far worse than that.

Edit corrected typo in time worked.
So how were any of you able to watch this? ("Sorry Because of it's privacy settings, this video cannot be played here.")
I think I have exactly this problem. How do I confirm this? "strace" does not show me any obvious problems. Where would I look to see if the JVM "flush" was giving me problems?
> If I wanted a desktop that valued form over function, I'd use a Mac.

If you did use a Mac, you'd find form and function. It is possible to have both.
"woman who sleeps around is a slut but a guy who sleeps around is a stud."

Of course this is true.

Hes a stud because it's a challenge for a guy to get a girl. That's why the colloquialism is "Getting lucky".

A girl can walk into any bar any night of the week and within 30 seconds have a guy going home with her 100% of the time.
Nope. The first thing I would do is put it in reinforced card case anyway, and I don't wear skinny jeans with tight pockets that would apply torque to the phone.
"Peanuts" in terms of value to the customer, but not in terms of value to the service provider. There's more than one perspective here.
Congratulations! :) Startups are more fun without these things (I think that's the implication of the article as well).
Hi, post author here. I didn't make it as clear as I could have, but the difference is that the problematic system had an unrelated process creating slightly more writes. I sort-of glossed over this with the 5%-20% difference in i/o util.

Unrelated write activity on a filesystem can cause cause fsync() calls in any other process to vary wildly in latency. This can be replicated, here's an experiment for you. First, run this:

strace -T -efsync ruby -e'loop { STDOUT.fsync; puts "a" * 120; sleep 0.1 } ' > ~/somefile

Then, in another terminal do a little bit of writing -- make sure it is on the same filesystem. For example:

dd if=/dev/zero of=~/someotherfile bs=4M count=1

On my poor little aws VM, here is what I see:

fsync(1) = 0 <0.025072>

fsync(1) = 0 <3.930661>

fsync(1) = 0 <0.024810>

That is, writing 4 megabytes in an unrelated process caused fsync() to jump two orders of magnitude.

Removing fsync() is an appropriate fix because we don't really ever want to flush this data to durable storage.
Does anyone think about doing logging to shared memory / memcached and then committing snapshots to disk at regular intervals via another process/machine?

If you're not all that concerned about consistency, each web server can keep their logs in a segregated memory space and then another process can combine/commit and send a flush command, leaving the primary machines relatively unencumbered.
Be sure to do some load testing with multiple simultaneous users! In my experience using a Pi as a Wi-Fi hotspot can be pretty unreliable.
Can non-Stanford students drop in or is this for students only?
Agreed on the book. It's great.

Another one of my favorites on this topic is this scene from Paprika:

http://youtu.be/e9xD_YYZrbA?t=23s
If you don't have much RAM I suppose you'd hit these limits much faster as OS would swap a lot of data onto drive.
Isn't this essentially syslog-ng?
> My impression of Roku's services is that there is much I cannot find.

This is what you're looking for:

https://plex.tv/

http://www.rokuguide.com/channels/plex-for-roku
Hi, post author here. The slight difference in i/o (specifically: writes) was the trigger. I talked a little more about that here: http://corner.squareup.com/2014/09/logging-can-be-tricky.htm...

And here: https://news.ycombinator.com/item?id=8359556

Even on the problematic host we only saw this latency issue in the 99th percentile. That is: even on the problem host 99 out of 100 queries were served as expected and only 1 out of 100 saw this additional latency.
To be clear- I AM NOT saying that reddit or 4chan supports these communities. I love reddit. I just think it's time we stop saying well it's the "internet" so trolls will be trolls and women just have to 'deal' with it.

We can say 'no, this is unacceptable behavior' and not allow violent threats against women to be tolerated on the platforms that we love.
Disagree strongly. These lectures are about 40 minutes and seem jam packed with good advice. A start-up isn't a formula but it does follow certain trends. Doing it wrong is a disaster and if you're taking on what can be a 10 year commitment without spending less than 20h exploring advice from some of the best data and people in start-ups you probably have misaligned your priorities. I suspect heeding the advice in the first lecture of this course would save most start-ups more time and money than 20h of the "CEO" co-founder.
I think on Sam Altman's part this is deliberate. He has distilled the core message of Grahamsian thought beautifully into slides. YC has been espousing this specific philosophy for a while, and I think Sam & PG both represent this school of thought.

This is part of the reason I believe PG picked Sam, he thought Sam internalized & helped form the YC approach to startups. The two are like Epicurus & Lucretius; Leucippus & Democritus.
China here, also dated back 15 years.
I guess all the people downvoting this are from other incubators. Not sure why this is being downvoted.
The funny thing is, I've fully sat on my iPad mini with a scary amount of weight on the couch several times, and the thing was completely straight afterwards. It seems like the smaller phones would be sturdier.
That's the kind of thing that I'm talking about!
It's not the idea of an open internet that he's alluding to, it's the idea of a place that goes beyond the laws of the land.

The obvious big ones are Uber and Airbnb, but then we get into things like amazon and sales tax.

And then there are companies like Aero , who construct elaborate legal fictions (having a million different antennas does not change much if your service is functionally equivalent to any VOD service by cable companies).
Good point. The Pi made sense for the hackathon. What type of wifi antenna have you used? http://www.raspberrypi.org/forums/viewtopic.php?f=36&t=76604
I use and love GNOME 3, and I think I'm a serious developer.

I love the simplicity. I love that jamming the mouse into the upper-right is the way to bring up all the application launching and window management UI, and the rest of the time it's out of the way. I love that it actually feels innovative, in that the design isn't just ripped off from some other OS. I love that non-essential features are relegated to extensions, keeping the core pure.

IIRC the problem with Eclipse is that it still uses gtk2, and thus gtk3 themes and config won't affect it. You have to manually edit the gtk2 settings to apply a reasonable theme. Ironically KDE can control gtk2 from its own control panel, but GNOME 3 cannot. Oh well.

Personally, I don't understand how any serious developer can use Mac OSX, yet almost every developer I meet these days in fact uses it, so... perhaps we are just projecting.
Surely, but for lecture 1 in a "Startup 101" series, you don't need to reinvent the wheel. We're talking about a very, very well documented path at this point, with established best practices.
Chrome looks about the same everywhere, emacs is customized within itself and I turn off all the window dressing on the terminals I use (no menus, no scrollbar, nada). Since that sums up 99% of my typical day to day computer usage there's no visual downside to xmonad for me. What looks even better than customized widgets (and I've tweaked emacs theme and the terminal settings to my taste long ago) are nice layouts that arrange all my windows in more or less logical ways automatically. Few things look as bad to me as a mess of randomly sized windows partially overlapping each other!
Spacebar except when idiot web developers implement using overflow:auto and force me to move a hand to the mouse wheel. I'm looking at you, google groups....
If you're swapping regularly then you have more immediate computer needs than a fast hard drive.
I think that's a good point, any reinforced case would likely prevent this from happening. I'm guessing we will probably see Apple offering free cases again as they did with the iPhone 4 if it is a common enough problem.
I too moved to KDE recently, and couldn't be (much) happier. Guh-nome has it's "you're an idiot" philosophy, which I find really painful. XFCE still has some rough corners. KDE is a traditional heavyweight desktop that is well-supported. Heaps of old-school customisability, allowing me to tweak it to my workflow, rather than corral me into its workflow.

Sad to see Debian not continuing with the shift to XFCE (I'd prefer KDE, but I think the lightweight DE is the better way to go for a 'universal' distro). Maybe with the next release?

I also use gkrellm, but only for gkrellm-bfm :)
Does syslog-ng use shared memory? I thought it communicated via open socket network channels.
How I Hired a Woman to Hire Herself
Because your comment does not add anything to the discussion.
Hell, we're now infrastructure-less. No VM's (except for our QA to test on, doesn't count), no static servers we can't just destroy and spin up another of in <5 mins, and no database servers that we have to manage.

It truly is a joy.
Brazil to have a 'Big Brother' for passengers travelling abroad
I loved the video and it really encouraged me to keep on trying.
I disagree that a startup should commonly start with an "idea". Start with an unmet need people are willing to pay for. Or take an existing category with a lot of bad products and make a truly better one that improves every aspect of the experience. Often, you'll see many startups working on the same "idea". Something like Google is truly rare (a genuinely innovative approach to search).
Sam kept bringing up the 10 year number

But: YC (and therefore every YC company) is < 8 years old

What startups succeeded after this long (AND were still actually considered startups)
> Is there an online way to sell used DVDs?

Honest question, since by implication Amazon is not an answer: eBay?
Tron: Legacy and Isomorphic Algorithms
I myself am in a position where I'm treated like an apprentice, and it's great. I've only been programming for a couple of years and the rate at which I'm learning, and the broad swath of knowledge I feel like I'm getting from the senior developers is great.
GNS3 Is Hiring: Community Manager + Python Developer
Check out the position here: http://www.gns3.net/hiring/

After coming off a successful 600K Crowdfunding campaign we are looking to significantly transform our product offering and the team around it. GNS3’s large and loyal user base of over 2M Network Professionals demand high quality solutions for their network problems – and we are looking for the next member of the GNS3 family to continue to provide just that.

GNS3 exists because there is a definitive gap for network professionals when it comes to building, testing, and training on network hardware. Since our inception in 2007 we have been building a piece of software that has now been downloaded over 9 million times from users in over 196 countries around the world. We follow our users from the dorm room to the boardroom and with GNS3 users now bringing the software into some of the largest companies in the world including: ExxonMobil, AT&T, PetroChina, Pfizer, Verizon, HSBC and more.

We are looking to fill the following positions:

GNS3 Support Specialist

Do you know GNS3 like the back of your hand? Do you want to be paid to help people use GNS3? Do you want to work from the comfort of your own home (or coffeeshop!) GNS3 is currently looking for several Support Specialists to join our troops.

Community Manager

Love the GNS3 Community? Want to be more deeply involved with the project? Think you can manage 2 Million Network Professionals? Are you incredibly organized? Super incredibly organized? Understand all the secrets to engaging an online and offline community? Come join us!

Software Engineer

Love Open Source? Want to do it for your career? GNS3 is currently looking for Rockstar Software Engineers to be a part of our growing GNS3 team. Send us your CV and your GitHub username – Jeremy is going to check in on you!
Nimbx Technology develops custom APP, design custom responsive website
Nice analysis! What did you use to make the word cloud?
With fsync() taken out of the equation this is essentially how a naive logger operates. The linux page cache plays the role of shared memory and only under rather heavy contention will a write() incur latency.

The trouble outlined in my blog post is that the logging framework was calling fsync() -- that is, specifically asking to flush the page cache all the way to disk.
I feel the same way towards Macs. Macs "just work" out of the box until you try to customize anything or install up to date dev tools. Gnome 3 works out of the box (for me at least). Plus you have source code if you need to debug or customize anything. I use Arch Linux which is not exactly easy to install. As soon as I install Gnome, however, the user experience becomes as easy as a Mac, but with a powerful Linux engine underneath. I am free to install the latest kernels and packages plus I have a desktop that a non-Linux user can use. Personally, I don't care too much about the Desktop Environment, as long as it doesn't get in my way. Gnome 3 allows me to use as much or as little as I want. I normally use command line tools, but in a pinch I can use the Display Manager or Network Manager to get set up in a different environment.
Provides influence/reach in another part of the world?
A few years ago I figured out how to make my Mac play a snippet of A-Team theme music when I would return to my desk. It lasted a very triumphant half day before I got tired of it.
Yeah, this isn't new. This is what the M7 (and the M8 inside iPhone 6) does.

And more importantly, this data is never stored in the cloud and never leaves your device, according to Apple.
LIVE: Mangalyaan starts entry into Mars orbit, all engines fired fine
Douchey enshrined in code. Fistbump!
Tips for Becoming Fearless Like 50 Cent
Mangalyaan: Will India's Mars mission reach the orbit?
Thanks for the suggestions - agreed, it would be nice to see version history (and not too hard to add, the server already maintains the history for the operational transformation algorithm)
Thanks for sharing. No text chat at the moment
And the not so wealthy since its a lot harder to buy property/commodities on a monthly salary, forget moving them around with you.
On by default? I'm not cool with that - are you?
Well, the easiest way to confirm is to turn off GC logging and see if your huge "GC pauses" go away. Alternatively, you could turn up the verbosity a bit - there's an extra flag for details about reference processing. In my case I was able to track down the exact line in the JVM from the log lines attributing the huge pauses to whatever trivial component occurred right after the first flush call.

If you record system metrics (eg. to ganglia) then you can also attempt to correlate large pauses to a large and rapidly declining number of dirty bytes in the fs cache.
Tools like Color Oracle[1] are great when checking UI color design for its color safety. Some monitor software also has similar features. E.g. NEC monitors' MultiProfiler tool supports a number of different color vision emulation modes; see the "Color Vision" pane in that app.

[1] http://colororacle.org/
Mars Orbiter Mission is in orbit around Mars
I love the developer experience that Heroku provides, however I wish the would lower their prices a little bit and/or introduce additional pricing tiers.

## The dynos are quite expensive by current standards

AWS has been continually dropping their prices, however those savings haven't been carried over to Heroku? Either:

1) lower pricing, or

2) improve the resource allocation for the current dynos at the same price point, e.g. 1x dyno - x1CPU + 1GB, and 2x dyno - x2CPU + 2GB.

## There is a big gap between 2x and Performance dynos

Java apps are recommended to run with 1GB RAM, so practically my only option is to continue to scale horizontally [1]. Maybe there is an opportunity for a x2 CPU and 2GB dyno at $100/mo?

Notes:
[1] - I would have loved to have a bit more memory at my disposal. 1.5 / 2GB would be ideal, but upgrading from 2x to Performance is too big of a jump ($70/mo to $570/mo).
Doing it wrong might actually sometimes mean doing it right.

Ycombinator companies have access to this advice yet most of these companies fail. Thats just how it is. You can get structural advice from a laywer the rest is up to you to explore.
Well latency is the easiest scenario to conjure (and I agree with you about it not being an issue).

Another way you could see worse fill rates would be a customer places a limit order that puts them somewhere back in the book. This limit order happens to trigger some threshold for the order flow trading algorithm that causes it to back off of it's own orders (lets say it cancels some orders on the back of the other side of the book). This in turn causes a price shift that moves away from the customers limit order making it fill later.

Clearly we are in the realm of pure speculation and probably not something that is important to the customers of robinhood. I was just pointing out that conceptually, by selling their order flow, robinhood could impact fill rates.

My guess is that this is more than offset by the lack of fees.
Interestingly, one of the creators of Gnome switched to a Mac. http://tirania.org/blog/archive/2013/Mar-05.html
I live in NYC and have not cooked in 18 months. I miss it, but it is just too damn convenient to eat my food from a restaurant/deli/bodega. I even turned off my gas, because I never used it.
POCKET JUMP: Jumpstart your car from the drivers seat or charge your smartphone
Yes it's all fine. All I want to say is that most ycombinator companies fail even though they have access to this advice.
ISRO Mars Orbiter Mission: Spacecraft successfully enters Martian Orbit
I would say the results of the "experiment" were pretty much what I expected after hearing about the research into the effects of caffeine on the news before.
There's still going to plenty of "finding your own way". I suspect most founders and early employees could find a lot of useful information in the material.
Why did we submit questions if the video was just going to cut out at the Q&A
The answer is Yes!
Sam: "Step 1, build something that users love"

How does this compare with an MVP approach where you put something out there first and test the market. Then there is the issue of runway. With enough time, you can start with an MVP and iterate in private beta until users love it, but in many cases a founder is not going to have that kind of runway. They have just enough resources to put something together, and they're going to have to go out to the market with that and iterate on the fly. Unfortunately, once you do get out there and need to take on all of the other responsibilities, then that's time taken away from building a great product.
mp3sparks "solved" exactly this problem by making content available at a low cost.

I wonder [0] if there is a modern company in russia or china offering streaming of video content without actually negotiating licenses with the relevant parties.

[0] just for the sake of speculation; I have a backlog of thousands of hours of stuff I'd like to watch on netflix, but prioritize doing other things
Not disagreeing. But whether it's actionable is what I would question.
Have you experimented with a log-structured filesystem? I once saw similar high-variation behaviour in a logging problem on extfs. Switching to NILFS pretty much got rid of variable latency entirely.
I'm definitely looking forward to hearing from the people who have built companies with their presentation abilities
within many anonymous forum networks there are sub groups specifically catered to the mens rights activists crowd and other groups of male internet comrades who do terrible things like threaten emma watson with releasing nude photos of her because she had the guts to speak up for women's rights.

The entire internet is not a 'hackers against women' online community because more than 50% of internet users are women.

Everything else you've said is so insanely misogynist there is no point in addressing it. Just so you know, YOU ARE THE PROBLEM. You are the troll. You are what keep women from participating on forums like this. Try to stop holding women to standards of social responsibility and start holding yourself accountable for why we feel so threatened online.
Sounds like you need to make your current company your former company.
But none of the reasons he lists have much to do with Gnome:

> Machine would suspend and resume without problem, WiFi just worked, audio did not stop working, ... [no] fighting the video drivers
Ease of configuration tweaks and number of plugin contributors. And I can write Haskell code well enough, I've even had some in production, but it was still a pain to try and navigate the types in the configuration, especially trying to get two separate plugins/libs to work together.

Mostly it was the plugin community, which is much larger for awesome and the shared philosophy of the community is very unix-y/small tools focused which is great and makes up for the copy/paste script-kiddy side of it.

Damn do I miss proper monitor support though, luckily I did kinda keep a separation between my main monitor and secondary naturally so it's not as painful for me as it would be for some.