skysight-inc/HackerNews huggingface dataset:
When you roll the logs at say 500Mb, there's the chance our monitoring system misses an error

Sorry but then your monitoring system is broken?
Why is its operation tied to log chunking?

Multiple logfiles for a day are harder to search

Not really. Often enough interesting events span multiple days (or cross midnight) anyways. Thus regardless of chunking you have to be prepared for that case.

What benefits does a split logfile provide?

I'll give you that "one file per day" seems easier at first, but I've been bitten by that too often. A script to identify the file-range for a given time-range via binary search is really easy to write, has only to be written once, and the benefits of fixed chunks are:

Easier handling. If you need to offload "50GB" from a given log-host then that's easier to do when you know that will be 50 files.

You don't risk a scratch disk running full (i.e. those small and expensive spindles that take the initial load) when the application decides to have a bad-hair day and put out 10x the normal volume for a while (e.g. interleaved with stack traces).

>>fetching an arbitrary header from the right file for a given context can be rather painful.
That's been a solved problem for a very long time. Just as recombining a separate trace log with a main app log based on time stamp is a solved problem.

I said painful, not impossible. You say you're dealing with 5GB/hour logs, then you must be well aware how long even the simplest merge-job takes on the slice of a single day?

>> When a serious error occurs then as much context as feasible must be provided
Yes this is the extraordinarily rare case where stack traces can be useful.

We must be living in different worlds then.

When errors pop up in the main logfile, which happens frequently, then the last thing I want is to stitch together context from other files.

A mere grep on a day's worth of logs takes about 10 minutes for us. Any kind of text-processing or "for each line perform lookup in $otherplace" quickly pushes that into the hours.
With the feedback we received, we do plan to update the pre-signup pages to include some details on the ease of signup.
Their networking setup is insane(ly awesome). A 2.8km microwave link to a gigabit connection, porta-john network cabinets, and donated IP address space so every attendee gets a dedicated public IP address. I've heard this field is right near a sewage works though, so be prepared(!) :-)
I took my humanities courses because I was required to. At the time, I would have been happy if all of my classes were math/CS. But afterwards, as in, a few years later, I realized that I probably would have learned most of the technical stuff on my own. It was being forced to study the non-technical that really taught me something new and interesting that I likely wouldn't have learned on my own.

This year marks ten years since I graduated. I cannot prove that college was a worthwhile thing, but I look back on that time very favorably.
The source package contains the license: GPL version 3.
What? Why in the world would increasing the S/N ratio be "terrible"? You want it to be greater than 1:1.

Also I dont understand these kinds of comments. Do you want us to email them that post with the quotes around them and attribute it to you?
"Linux Mint" version? It should be "Debian" version. Mint is based off Ubuntu which is based off Debian. ".deb" are for Debian-based distros, not for Linux Mint.
I remember somebody who worked for NASA telling me it cost 750K to test the fluorescent lightbulbs for the spaceships. The crappy technology (by Earth standards) is mostly due to testing constraints, from what I understand.

Just think of age testing - they probably want the camera to last at least 5 years. If the camera you want to send up has been developed in the last year, how do you really do that? In a lab, for reliability testing of new components, typically you temperature cycle equipment, up and down every couple of hours, to simulate time passing, in order to try and compress the time frame required to test the aging rate, but we all know it doesn't really achieve what we want it to too well.
I know it's been a few days, but, just wanted to add that this is a good point, and a part of what I meant with not using VbV lightly. There are valid reasons to use it, but frankly, it should be close to the last thing you implement.

The only times I've used it where when offering a b2b product/service where fraud was a real fraud.
> I'm conservative because I dislike complexity

Except a lot of conservatism as defined here is all about complexity in terms of 'big design up front' methodology and, really, having a big methodology in the first place, along with having a lot of testing and static analysis tools.

Ada is a conservative language. C is extremely, red-diaper liberal.
If someone posts a helpful answer to your question, it's fine to say "thanks" in a comment (and the mods will not remove that.)
So can you use this with C functions compiled normally with gcc? It seems like that would be even more useful.
Descent of the Phoenix
http://apod.nasa.gov/apod/ap080530.html

Curiosity Drops In
http://www.uahirise.org/images/2012/details/cut/ESP_028256_9...

from: http://www.uahirise.org/releases/msl-descent.php

A Wheel on Mars
http://apod.nasa.gov/apod/ap120807.html

landing site:
http://www.uahirise.org/images/2012/details/cut/landing_site...

Curiosity Before Mars: Seven Minutes of Terror (video 5:08)
http://apod.nasa.gov/apod/ap120731.html
fyi, there is a term mortality protection gap known about in insurance at the moment, in which limited duration mortality-based benefits cost significantly less than the utility customers derive from them. There is a report somewhere, but I don't know if it is confidential. http://www.swissre.com/reinsurance/insurers/life_health/Swis... is related.
Regardless of whether TM deserved its success, its time has past. I took this as a reminder to finally delete the binary from my Mac. Sublime all the way, and without irritating licensing restrictions.
Google to pay record $22.5m fine to FTC over Safari tracking
Nixon was a Pre-Reagan Establishment Conservative. Such Republicans are not tolerated by the modern GOP, as Nixon's record regarding OSHA, the EPA (which he also created), and Universal Health Care will demonstrate.

Political parties evolve over time, sometimes quite drastically, as the political makeup of the country as a whole shifts and changes.
Me too (with Nvidia, never had an ATI card).
I had Thinkpad T510 with Nvidia and used it with two monitors plugged into docking station. Nvidia's proprietary driver is absolutely horrible when it comes to switching between laptop screen and monitors when docking/undocking.
Open source driver for nvidia is marginally better in this regard, but is incomplete and unstable and not really an option. Now I have T520 with Intel graphics, and it works very well.
The general risk-adverse vs. change-oriented paradigm makes a lot of sense. The problem is that it not limited to the technical realm in most organizations. Technology decisions often need to be justified by management who don't necessarily use purely technical criteria for their choices.

Some rather simple criteria can be used to group languages - age and popularity. Perl, JavaScript, Java, Visual Basic are conservative in that they are popular, well known, established languages (even though they cross the Yegge's whole spectrum). Haskell, while extremely conservative technically, is extremely liberal in many organizations - where there are no currently implemented projects using the language and no programmers experienced using it.
Algorithm tracks crime, rumours, epidemics to source
How to lose followers on Twitter – a helpful guide
The Problem with his model is, that he assumes that he ignores the "shoulder of giants" effect in his model, since he assumes that a later researcher has the same number of points as the earlier, but only hard problems to solve. ( Perhaps I will extend his model a bit later.)
> C is just low-level assembly with some structure attached.

To make it clearer: By the standards of the article, C is quite liberal indeed. C++ is significantly more conservative.
Sprint to use French light-based network towers to up its urban network coverage
Profit is whatever your accountant wants it to be. Revenue is much more objective.
The way its macros worked was brilliant and much imitated (so much so that it's no longer a differentiator).
How are you going to power the laptop?
We're not meant to post comments like this on HN, but I also enjoyed the post, so please continue to write and post stuff like this.

One of the strengths of HN's ranking system appears to be that story downvotes are pretty limited, so that stories that appeal to just 10% of readers can be aired too - don't take it to heart.
The tents also get power.
I think some of the details were discussed here on HN, but
the only part I can find is the description from their blog:

http://blog.emfcamp.org/post/27143646219/emf-camp-the-site-a...

EDIT: here's the previous discussion on the network and such

http://news.ycombinator.com/item?id=4344620

I wonder if we're allowed to make jokes about packet dumps?
I know this is an old thread but I think I do want to respond.

Legally the court will decide but that doesn't mean that we can't have views or that either company is necessarily behaving legally (if you steal something you aren't behaving legally until convicted). For my perspective I am assuming all patents valid (if they are invalidated the license fees are no problem as they will be zero).

Samsung is in my view breaching promises made to the world including me and threatening the whole standardisation process. At the very least everyone needs to understand just how weak FRAND commitments are and adjust their behaviour accordingly. If allowed to stand Samsung's view of FRAND could do massive global harm as it will mean even more desperate fights to keep patented technologies out of standards where the patents are owned by companies not trusted to 'do the right thing' which could lead towards standardisation deadlock. It could also lead to all sorts of other companies all trying to extract all the value of standards making them unaffordable in many use cases.

Compared to this I really can't see anything unfair at all in what Apple is doing. Saying if you want to use this unnecessary feature you have to pay us a lot of money sounds fair to me, you can freely choose not to use it (damages/back licenses before the patents are confirmed by a court should probably be lower). The damages claims are just claims I don't expect to be fully granted but that is just the system isn't it, claim the moon on a stick expecting to get half a stick at the end.
Life Without a Pulse
There's a huge mismatch between D3 and canvas. D3 is all about binding data to structured documents (i.e. HTML or SVG). Documents are dynamic and interactive, but canvas is fundamentally just a bitmap context. It just doesn't make sense to render D3 to canvas... but you can certainly use any of D3's useful functions for calculating layouts or paths or colors.
And I'm pretty sure that the fewer papers your read the more likely you are to come up with something you think is new, but isn't.

Of course, depending on the context whether something is "new" or not might not matter, it certainly does in academic research, but if you are making stuff work it's less of a factor.
I'm a British taxpayer, but let's put this into perspective: turnover of £395 million ... The search giant reported overall losses of £24.1 million in the UK

If my business made a loss, it wouldn't pay much tax either (beyond the VAT I have to collect, employer NICs, not to mention the income tax my employees pay, etc.)

If there's anything fishy here, it's why Google is making a loss on such healthy revenues in the UK when it's so profitable in the US.. but the tax itself is not surprising given the lack of profit.
Calling it, the future of design, right here!
Just because you win an argument doesn't mean that you are right.
Cincinnati Bengals vs NY Jets live stream watch here NFL Preseason 2012
you can watch here Cincinnati Bengals vs NY Jets live stream
Match scheduled:
Date : FRI, AUG 10 2012 Time: 7:30 PM (ET)
NFL Preseason 2012 venu: Paul Brown Stadium
Cincinnati Bengals vs NY Jets live stream watch here NFL Preseason
2012,Cincinnati Bengals vs NY Jets live stream watch here NFL
Preseason 2012,Cincinnati Bengals vs NY Jets live stream watch here
NFL Preseason 2012,Cincinnati Bengals vs NY Jets live stream watch
here NFL Preseason 2012.
creating a hedge fund, or any kind of fund, was something i should be thinking about in my 40s or 50s when I wanted a more traditional role in finance with a lower risk/reward profile.

Many of the more prolific hedge funds were started by people much earlier in life. David Einhorn, for example, started his fund at 28.
Looks really excellent. Wanted to check it out to see if it's something I could get in to - didn't realise it was iPhone only until I already gave over my email address. Would be nice if this was clear on the website.
Damian Conway weighs in on new features, best practices and Perl’s future
If they depend on something specific to Mint, or on Mint-specific versions of packages, then these are Mint packages. I'm not sure if they do, but it's a possibility.

Practically it may depend on where they were produced / tested. If Mint is all the developers use, then it would be tricky for them to decide if the packages are compatible with previous distros (Ubuntu, Debian)
My assumption that people almost always drive in the US seems flawed.
On a bigger scale, doesn't that widen the cultural gap between areas? Like people in SF or NY can party at work because they don't drive home and people in cities where there is no real public transportation system (LA I believe) can't benefit from that relaxing perk.
Brazilian private yacht wrecked in icy antarctic waters.
Looks cool.

One thing I was wondering is if there was anyway to read the table cells? And read them interactively? (perhaps have the option of "on changed" event callbacks) It would be really nice if the table can be used to control the graphics output.

A suggestion - an option to swap the tabs (source code, table, diagram, etc) between tabs and dock windows would be really really awesome, that way I could, for example, view the source code and the graph side-by-side.

I haven't got the time to check out the source code right now, but maybe over the weekend or early next week I will, so I may try and add these features myself, so don't worry about it if you don't want to add them just now.

In any case, good job! I've been meaning to brush up on my Lua skills for a while now and this seems like a great tool to use to play around with the language.
God says...
C:\Text\WALDEN.TXT

ay & Co. have put animals to their best use, for they are all
beasts of burden, in a sense, made to carry some portion of our
thoughts.
The mice which haunted my house were not the common ones, which
are said to have been introduced into the country, but a wild native
kind not found in the village. I sent one to a distinguished
naturalist, and it interested him much. When I was building, one of
these had its nest underneath the house, and before I had laid the
second floor, and swept out the
As an occasional Javascripter, I've gone looking for this several times, and each time been bemused to discover it isn't there (probably just as an instantiatable EventTarget).

Better package management might help, but some things are fundamental enough that they belong in the core library. I'm pretty certain this is one of them.
Off-topic but does Google Plus offer any way to view a post nearly full-screen, without all the extra margin and white space taking up 2/3rds of the screen?

A bit annoying that the post text only takes up about 33% of my available screen real estate, even on the "view single post" URL: http://cl.ly/image/1p1B2o3D262g
When the design was finalized these cameras WERE pretty state of the art. Once something is finalized for a space mission it is very very hard to change it because everything else is designed around it.
If you could teach yourself in an afternoon what was covered in a 10 week class, then you probably wouldn't have failed out.

The same points I make on every post like this.

1) College isn't for everyone.

2) The 'I'm so smart that college was a waste of time' people should have just gotten a scholarship and not paid for college. 5 out of the 5 schools I officially applied to offered me scholarships. All were in the top 50 schools for my chosen major (originally, aerospace engineering). If you are smart enough that college is a waste of time, then you are also smart enough to not have to pay for college.

3) Don't extrapolate the computer science major to others. There are better books, tutorials, and online communities for hacking than seemingly any other profession. Try to find the "O'Reilly Press" of aerospace engineering pumping out 100 books a year on every imaginable topic - it just isn't happening. Same for StackOverflow, HN, etc.

4) Don't extrapolate the software engineering profession to others. It's normal for non-CS majors to be getting software engineering jobs. I personally graduated with a mechanical engineering major and CS minor. I'm now working in software engineering. The company I just left (where I worked as a mechanical engineer) would never, ever, hire a computer science major to fill a mechanical engineering job. The only three possible majors other than ME that they would hire are math, physics, or aerospace engineering.

5) If you don't do well, college is a waste of time & money.
You wrote that? My hat's off to you, sir. Did you know they have an entire category http://en.wikipedia.org/wiki/Category:Exploding_animals now? :)
Autonomous robotic plane flies indoors at MIT
Because there's a lot of useless shit being posted lately.

The revolving door of Ouya, App.net, sexism in STEM, Apple, and nostalgic blogspam is monumental, the number of 'startups' out there that are not startups is scary (note: 'cool project' is not the only criteria for having a startup), and the relative level of meta discussion (like this) is slowly climbing to an unacceptable level.

If everyone will just shut up and chill out, the problem will correct itself. These things happen in waves, and should be no surprise to anyone who has been on the Internet for more than four years.
Automatically associating strings of text with English Wikipedia concepts (2011)
I'm not disagreeing with the sentiment, but is "consistent user experience" necessarily something that should be a goal?

There's more to it, but when I hear that I'm reminded of web site "designers" that only use photoshop and focus/obsess over pixel-perfect layouts and font-sizings, to get everything to match exactly what their original photoshop 'design' looks like on their monitor, ignoring the variety of browsers/devices that may also visit the site.
A small symmetric encryption message launcher website
keep it going. The underlying message of the post was spot on for founders, young people, future risk takers alike. may not hit every demo' but it worked for me. thanks.
"concentration camps" where very well answered.

Torture: there is waterboarding and also some prisoners where sent to third party countries to be tortured there (which is an operation complex enough that there was some official involvement) and some others where tortured directly in their country of capture (at such a scale, and for finding so important information that I don't really believe these were only rogue CIA agents).
FTC Levels Record Fine for Google’s Safari Privacy Bypass
Show HN: A jQuery tooltip plugin with intent checking and queuing
Maybe you could use LLVM/Clang to parse the headers. That way at least the parsing would be consistent with the compilation. I don't know how difficult it would be to access such type information, but I thought the whole point of LLVM/Clang was to be usable as a library.
It would help if we knew what UK Google's real profit was (as opposed to the accounting profit (loss) it (doesn't) pay tax on).

e.g. I expect UK Google pays a lot to license various Google trademarks from an offshore Google subsidiary. How much?
Write any javascript code with just these characters: ()[]{}+
In my country companies pay no income tax if there is no profit (they do pay other taxes for each employee). I think this is pretty common in Europe, as taxes are usually taken from profit no revenue.
Maybe not the best forum for this, but, Thanks Mike! I've been exploring d3 for a few months now. IMHO, it's one of the cleanest, most powerful JS libraries out there. The examples are great.
Actually they do. Write some interesting posts on tumblr, get it on LinkedIn, get high score on stackoverflow and you'll see the google recruiters writing to you at some point.
I know I will regret this but here is a little survey I whipped up quickly. It's static so results are local to your browser.. Enjoy:

https://dl.dropbox.com/u/704864/software-politics.html
If there is a satellite that orbits between Earth and Mars parallel to orbit of Mars, there could be better transmission.
Wikipedia Gets a Makeover. Should It Look More Like Google?
Boot Camp File Lists Unannounced Mac Pro, iMac
I like the pricing $10/$20 for iPhone/iPad - that's a bit more of a sustainable model than the typical $1/$2 pricing.
Most of the download links are broken on the English site - looks like they're pointing to the previous version. http://www.brischalle.de/Lua-Quick-Try-Out/Lua-Quick-Try-Out... has the correct URLs.
Apple v. Samsung: the complete guide to a billion-dollar trial
It might not be for everyone, but a college with courses like "World of Business" and "Data Base Concepts" is laughable as all hell anyway. At least go to a real college.
Not that anyone cares:

Liberal <---------------------|-----------------------+---------------------------------------------> Conservative

Or as a totally unscientific number: -24
Profits for the books are somewhat malleable by an accountant. There are still limitations to what you can do. For tax, rules are tighter. Even revenue is often not objective. For example, I sell someone a subscription to a service for a year. Do I record the revenue now (not a good idea), spread it out over 12 months (practical) or every time a user uses the service (not so practical, more realistic?).

Corporate tax is on profit. VAT like taxes are closer to revenue (or more accurately, closer to when you get paid by customers).
This release suggests that the image is only 1/8 of the full resolution capability of the camera system:

http://www.jpl.nasa.gov/news/news.cfm?release=2012-237#5

It also links some other images (and full image files, rather than a flash viewer).

Edit: Also, the tif I just downloaded has more detail than the WSJ viewer makes available.

So if you are judging based on the quality of the image in the linked story, maybe give it some more time.
Why Is Vringo Spending $31 Million On Hundreds of Nokia Patents? Ask Underdog.
How well does that front page convert? It doesn't say what it does (I'd guess it's a simple todo list app from the tickyboxes, but can't be sure).
It's sad, in some ways, but I'm not sure that Mozilla had any choice in the matter here. Using the OS to provide decoding makes sense as a compromise here.