John Carmack about open source and anti-AI activists
twitter.com295 points by tzury 13 hours ago
295 points by tzury 13 hours ago
https://xcancel.com/id_aa_carmack/status/2032460578669691171
Has anyone else noticed a cultural shift around monetization of output? I think there wasn't as much back when I first started using open-source programs, both as a user, and a small-time contributor for decades now. And I've noticed this on other things too. A short while ago, someone on Reddit pointed out that something on Google Maps was wrong and so I went and submitted a fix and told them how to and I received a barrage of comments about working for free for a corporation that's making money off me. I think if people want a revshare on things then perhaps they should release under a revshare license. Providing things under open licenses and then pulling a bait-and-switch saying "oh the license isn't actually that you're not supposed to be doing that" doesn't sit right with me. Just be upfront and open with things. The point of the Free Software licenses is that you can go profit off the software, you just have certain obligations back. I think those are pretty good standards. And, in fact, given the tendency towards The Revshare License that everyone seems to learn towards, I think that coming up with the GPL or MIT must have taken some exceptional people. Good for them. > A short while ago, someone on Reddit pointed out that something on Google Maps was wrong and so I went and submitted a fix and told them how to and I received a barrage of comments about working for free for a corporation that's making money off me. Did you respond by asking them how Reddit makes money? The anti-corporate mentality isn't new, but it does surface in different ways and communities over time. The Reddit hivemind leans very anti-corporate, albeit with a huge blind spot for corporations they actually like (Reddit itself, their chosen phone brand, the corporations that produce the shows they watch). The Reddit style rebellion is largely symbolic, with a lot of shaming and snark, but it usually stops when it would require people to alter their own behavior. That's why you got dog-piled for doing something productive on a site where user-generated content is the money maker. Hell, reddit hates on reddit all the time. Spez in particular is hated across the board. Agree that they largely don't change behavior. Although I will say, I've not logged into my account since the API shenanigans and don't regularly visit the site anymore. I'm mostly just on here and fark. Most left leaning forums look negatively on profit motive, and reddit is largely very left wing. Whatever that means nowadays. It's reasonable to be wary of incentives, but sometimes that zeal is misplaced. Having said that, I don't think any site can go mainstream and maintain a semblance of quality discourse. If nothing else, it will become botted and infiltrated by shills. But even without that, normies will ruin it much earlier than any sophisticated attacks are necessary. Haha, that's funny. I didn't think of it at the time and I was more surprised than anything. By the way, I have had your comments highlighted for a while now and I've never regretted it. Good stuff. ... There's a highlighting feature? I just have a Chrome extension. It's not a HN-native feature. Link in profile if you're curious. Avoiding every corporation that does stuff you disagree with just isn't feasible. All we can do is weigh their business model and other practices with the value we get out of it. People on Reddit who also have a problem with Reddit are obviously on Reddit. That is tautological. It doesn't mean they aren't avoiding other companies for similar reasons, which wouldn't make them a hypocrite either. I've never publicly scolded someone for doing free work for tech monopolies but I do understand the impulse. The problem is that it's a completely one-sided relationship, and there are perfectly legitimate concerns about how the biggest tech companies are using their wealth and power. At this point I doubt much of anyone would expect a large tech company to go out of its way to lose money in order to support human communities. They take what they can, and ruthlessly kill products and services the minute they think it helps their bottom line. Google and others don't need to rely on free volunteers, but it's certainly more profitable for them. Does Google making an extra $10B/year make the world a better place? Maybe, I don't know, but it's not crazy to think the answer is no. It not a completely one sided relationship. I'm using google maps for free!!! That's HUGE benefit to me. That google makes money from it is irrelevant to me. They're paying me by providing a free service that I get tons of usage out all the time. This, I submit photos and corrections to maps all the time, because those photos and corrections help me as well as other people. I derive way more benefit than I personally provide but I'm OK with that and google is too. Yeah, and you made a fix for both yourself, and presumably other people as well. Additionally, some people submit fixes for recognition, too. It's not free. The cost is the information about where you are and what you're looking for basically at all time. It's free, but it's a dependency. I don't have sharp rhetoric for it, but I could find bipartisanship with right-wingers if they apply the "big government giving you welfare means they can take it away from you" to free web services. OpenStreetMap is always behind on business data, but it has data that Google doesn't have, and it can't be taken away near as easily. And requires no account at all. This cultural shift exists and it will intensify as long as consumer prices and cost of living continue to rise at the same time corporate profit margins do. This is a simple, easy link to make, pretty much everyone's now aware and has stopped buying the excuses. Consolidation and an increase in straight up, unpunished criminal monopoly and cartel activity within corporate America have given rise to this new culture. Luigi Mangione will not be the last of his kind. > Has anyone else noticed a cultural shift around monetization of output? I think it's simply due to the economy being in the shitter for the non-"Capital Ownership Class". 1977-2007 was generally a good time in the US if you survived by trading your time/knowledge/expertise for a wage as most people do. This is also the time in which F/OSS came into existence. If you had a decent job during that time, then the future looked bright and you didn't think twice about giving some of your leisure time away for free. > 1977-2007 was generally a good time in the US if you survived by trading your time/knowledge/expertise for a wage as most people do. This is also the time in which F/OSS came into existence. FOSS came into existence during this time because computers and the internet became available, not because it was a specific economic situation. > If you had a decent job during that time, then the future looked bright and you didn't think twice about giving some of your leisure time away for free. This seems like rewriting history. Tech salaries today are higher than they were back then. There was even a whole lawsuit against companies caught suppressing wages during that time. Tech compensation went up significantly after the period you cited. > because computers and the internet became available Because of Bell Labs (inventors of the transistor & Unix & UUCP & so much more) which was so well-funded by the post-WW2 US economic situation. The Internet? DARPA! DARPA? Post-WW2 US M.I.C.-driven economy. The list goes on and on and on. F/OSS owes so much to The Marshall Plan. Is this a sweeping, reductionist PeterZeihan-esque argument? Sure, but I think it's valid. > This seems like rewriting history. Tech salaries today are higher than they were back then. So? Does the future look bright to you? Most of the SWEs I know wouldn't say so. How bright you think the future will be has a direct impact on your long-term planning and, for many, results in prioritizing hedonistic activities in the short term, not F/OSS. MIT and BSD licenses are kind of obvious. They are academic licenses, named after universities. The idea is that you have people paid to create something of potential value, but the value of the outputs has only a limited and indirect impact on their compensation. If someone finds the outputs valuable, they should mention it in public, to let the creators use it to demonstrate the value of their work to funders and other interested parties. > I received a barrage of comments about working for free for a corporation that's making money off me The problem is that the big tech companies aren't holding up their end of the traditional social contract. I like to think of the wider open source community as one giant group project. Everyone contributes what they can, and in turn they can benefit from the work everyone else has done. The work you do goes towards making the world a better place. I have absolutely zero problem filing pull requests for bugs I encounter or submitting issues on OpenStreetMap, because I know that in return I get the Linux DE and reliable maps in other towns. If you want to make it political, it's a "from each according to their means, to each according to their needs". The big tech companies operate completely differently. They see open source contributors primarily as a resource to exploit. Submit a single fix on Google Maps? You'll get zero credit, they'll never stop bothering you with popups about "making improvements", design their map around what is most profitable to show, and they will of course log your location history and sell it to the highest bidder. And they are getting filthy rich off of it as well. I couldn't care less about getting monetary compensation for some odd work I do in my spare time, but there's no way in hell I'm going to do free labor for some millionaire who's going to reward me by spitting in my face. The amount of value Google Maps has given me is far beyond what I'd be willing to pay in actual dollars. Agreed: the opportunity to be taken to a rocky dirt road through swamp grounds on the outskirts of a small town in Greece is something I'd never get if not for Google Maps :) (and many similar stories) I only use Google Maps for their live traffic info, which they so nicely collect out of majority of Android users driving around. I'd love it if OSM apps could leverage that information for navigation too. > The problem is that the big tech companies aren't holding up their end of the traditional social contract. This analogy feels too strained. Google gives away Maps, Gmail, and other products for free. A little UI widget inviting users to submit fixes is hardly an onerous demand. > and they will of course log your location history and sell it to the highest bidder. Google does not do this, no matter how many times this myth gets repeated online. I think a lot of people in the Reddit and Reddit-adjacent world believe this is true because it gets repeated so much, but it's not true. Ironically, Reddit makes money by packaging up user's content and selling it to 3rd parties. > someone on Reddit pointed out that something on Google Maps was wrong and so I went and submitted a fix and told them how to and I received a barrage of comments about working for free for a corporation that's making money off me This tells you about Reddit's demographic and nothing else. Remember Reddit has a dedicated sub for antiwork. It used to have a sub for shoplifting (I'm not kidding.) I think we've all been burned by 20+ years of exploitation in the guise of "free product." Google more or less spearheaded that movement. I agree we should all be community-minded and have nice things, but when you look at how the rewards (social and monetary) are shared it's overwhelmingly disproportionate. yes, and no. there is profit and there is excessive profit. if i build something to make my linux experience better and share that with the world, and a few consultancies use that to make the linux experience for their customers better, then that is fine. but if my tool becomes popular and a megacorp uses it to promote their own commercial closed source features alongside it, then that's excessive. that's one reason i like the AGPL, it reduced that. but in my opinion the ideal license is one that limits the freedom to smaller companies. maybe less than 100 or 500 employees, or less than some reasonable amount of revenue. (10 million per year? is that to high or to low?) and even for those above, i don't want revshare, just pay me something adequate. Who is stopping you from licensing your code that way then? It's not open source, because the definition of open source doesn't allow you to place any restrictions on who can use it or for what purpose. It's why licenses like "Don't use it for evil" or "Everyone except Anish Kapoor" aren't acceptable for a lot of Linux distros. In practice your best bet is probably a license where everyone can use it, but which is incredibly hostile to use in a for-profit environment. Think AGPL, where you risk being forced to open source your entire unique-selling-point proprietary software stack. some people are working on that, among others there is bruce perens: https://web.archive.org/web/20251206160538/https://perens.co... (sadly his site seems broken, the static files still work however: https://perens.com/static/DEVELOPMENT_LICENSE.txt ) FUTO is also exploring this space: https://sourcefirst.com/ It has always been like that, except we used to call it demos, sharewhare, beerware, postware,... The free beer movement came out of UNIX culture, probably influenced by how originally AT&T wasn't able to profit from it. Because the ratio of developers who do it for money to developers who do it for love of developing has dramatically increased, as computer science became a subject people studied for economic reasons, not just for fun. I would like to offer a similar, but somewhat different opinion on one aspect of what you talked about regarding "revshare": If I notice and issue on my own, and it bothers me enough / I feel that other users would benefit from it, I have no issue providing that information to the source maintainer for free. If however, I am contacted by the maintainer in anyway requesting feedback, suggestions, or input (i.e. "Rate us on the app store!", "Email us with any problems you have.", etc.) I except any feedback I provide to be worth more than an unprompted message, and in turn, I expect something like a lower bill, a discounted rate on their store front, a credit in their auth page, or some other kind of material gain from it. Basically, if I am being solicited and prompted to do something, it wasn't my idea in the firsr place, so it ought to be worth my time to do so. They have already gone to the effort of asking, so they (presumably) find value in it. I ought be compensated for that value. Using Google as an example: one of the few products of theirs I like is Opinion Rewards. They actually pay you (in store credit) for responding to their surveys. It's a fair trade off. They ask me basic habits related to shopping, etc. I get a 25 cents or so every time I respond. Yeah, I think the paradigm has shifted. There's a perception that, while these companies have always profited off of our inputs, that we both benefitted. We contributed to a public good, they provided the platform, and profited off that platform. Now it feels like the public good is being diminished (enshittification) as they keep turning the "profit" knob, trying to squeeze more and more marginal dollars from the good. The system still requires the same inputs from us, but gives less back. I think one of the more prominent issues folks take with mass training on OSS is that the companies doing it are now profiting for having done it. In his follow-up post he talks about him open sourcing old games as a gift, and he doesn't much care how people receive that gift, just that they do. He doesn't acknowledge that Anthropic, OpenAI, etc, are profiting while the original authors are not. The original authors most of the time didn't write the software to profit. But that doesn't mean they don't care if other people profit from their work. It's odd to me that he doesn't acknowledge this. I'm no Carmack, but everything I've released as open source is a gift with no strings (unless it was to a project with a restrictive license). A gift with strings isn't exactly a gift. If you take my gift and profit, it doesn't hurt me, there were no strings. Your users presumably benefit from the software I wrote, unless you're using it for evil, but I don't have enough clout to use an only IBM may use it for evil license. You benefit from the software I wrote. I've made the world a better place and I didn't have to market or support my software; win-win. I've done plenty of software for hire too. I've used plenty of open source software for work. Ocassionally, I've been able to contribute to open source while working for hire, which is always awesome. It's great to be paid to find and fix problems my employer is having and be able to contribute upstream to fix them for lots more people. I'm the same, I've seen some of my stuff pop up in the weirdest places and I was ok with it. But I understand and respect that people who published code under restrictive licenses may have a problem. The GPL is absolutely "NOT-a-free-gift" license, in both wording and spirit. If someone published something as MIT and doesn't like it being used for LLM training, yeah that person can only blame themselves. For GPL, it all depends if you consider a LLM "derivative software" of the GPL code it was trained on. It's fair to have an opinion on that either way, but I don't think it's fair to treat that opinion as the obvious truth. The same applies to art, a lot of it is visible on the Internet but that doesn't make it "a gift". To clarify, GPL is not a free as in "free gift", but it is free as in "freedom". The giving back part is strongly related to the "freedom", not related to whether you profit from it or not. > To clarify, GPL is not a free as in "free gift", but it is free as in "freedom To clarify further: "freedom" for the end user, and not the developer leveraging GPL code in their software product. MIT license requires credit. Ahhhh yes that's one that lawyers might have fun with. MIT says: > The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. My personal thought on that: it's going to be almost guaranteed that, if an LLM is producing stuff it clearly derived from a certain piece of code XYZ, it will also be capable of producing the correct answer to the question "what's the license for XYZ?" And lawyers will successfully argue that this counts as "included". The point was to separate MIT and GPL was wrong. > My personal thought on that: it's going to be almost guaranteed that, if an LLM is producing stuff it clearly derived from a certain piece of code XYZ, it will also be capable of producing the correct answer to the question "what's the license for XYZ?" And lawyers will successfully argue that this counts as "included". The MIT license terms are not say the name the license if asked. They are The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. And this would be improbable for many reasons I think. Presumably you are licensing your code as MIT or a similar license. Not all code is licensed that way. Some open-source code had strings attached, but AI launders the code and makes them moot. If you want to attach strings which involve restricting access, open source is not the way to go. You're right - the reality of the world today is that open-sourced code is slurped up by AI companies, all questions of legality/ethics aside. But this was not the reality of the world that existed when the code was licensed and released. That is why it is easy to empathize with code authors who did not expect their code to be used in this manner. Nah I neither agree nor empathize. Anyone with a reasonable understanding of how the internet works knows that putting something on it means that thing can be used in a myriad of ways, many of them unanticipated. That's something one implicitly signs up for when posting content of their own free will. If the gift isn't to be wholly given, don't give it at all; put it behind a wall so it's clear that even though it's "available", it isn't a gift. By far the most popular strings involve restricting restricting access. That is, viral licenses which require derived works to also be open source. No one cares. Copyright in general is done, and we are all stronger now. Don't fight AI, fight for open models. Great! So I assume it is now Completely Fine to rip Netflix / Hulu / Disney+ / whatever and share it with everyone I know? Copyright isn't "done", copyright has just been restricted to the rich and powerful. AI has essentially made it legal to steal from anyone who isn't rich enough to sue you - which in the case of the main AI companies means everyone except a handful of giants. TIL I'm "rich and powerful." It doesn't feel any different, I've got to say. The thing is, copyright is not done. The legal framework still exists and is enforced so I am not sure how to read your reply as anything other than a strongly worded opinion. Just ask Disney. I use AI every day in my dev workflows, yet I am still easily able to empathize with those who did not intend for their code to be laundered through AI to remove their attribution (or whatever other caveats applied in their licensing.) > Just ask Disney. Disney saw which way the wind is blowing and invested over a billion into OpenAI The thing is, nobody in China gives a rat's patoot about copyright. If we do, they win. A compromise might have been possible, based on treaties engineered by the people who brought us the TPP, but nobody in the current US government is capable of negotiating anything like that or inclined to try. And it wouldn't exactly leave the rest of us better off if they did. As a result, copyright is a zero-sum game from a US perspective, which matters because that's where the majority of leading research happens on the majority of available compute. Every inch of ground gained by Big IP comes at America's expense. So they must lose, decisively and soon. Yes, the GPL will be lost as collateral damage. I'm OK with that. You will be, too. I know tech normally breaks the rules/laws and have been able to just force through their desired outcome (to the detriment of society), but I don't think they are going to be able just ignore copyright. If anything those who depend on copyright see how ruthlessly/poor faith tech has treated previous industries and/or basically anyone once they have the leverage. Tech is becoming universally hated whereas before it was adored and treated optimistically/preferably. there are no open models. none. zero. there are binary files that some companies are allowing you to download, for now. it was called shareware in the old days. one day the tap will close and we'll see then what open models really means From a political perspective there's no closing that tap, only opening it further. As long as China exists there will be constant pressure to try to stay ahead, or at least match Chinese models. And China is gleefully increasing that pressure over time, just waiting for the slip that causes a serious migration to their models. Not true; e.g. https://allenai.org/open-models . For my own purposes, open weights are 95% as good, to be honest. I understand that not everyone will agree with that. As long as training takes hundreds of millions of dollars' worth of somebody else's compute, we're always going to be at the big companies' mercy to some extent. At some point they will start to restrict access, as you suggest, and that's the point where the righteous indignation displayed by the neo-Luddites will be necessary and helpful. What I advocate is simply to save up enough outrage for that battle. Don't waste your passion defending legacy copyright interests. > and that's the point where the righteous indignation displayed by the neo-Luddites will be necessary and helpful At that point it will be far, far, faaaaar too late. > Don't waste your passion defending legacy copyright interests The companies training big models are actively respecting copyright from anyone big enough to actually fight back, and soaking everyone else. They are actively furthering the entrenchment of Big IP Law. I'm not sure that's true. You may not see it that way, but you're still participating in a capitalist society. Not that there's necessarily something wrong with that, but you have to acknowledge that and act accordingly. Most people wouldn't work for free. Yet companies like OpenAI, Anthropic and Google exploit OSS maintainers like that. They're winning and we're losing. And if they have their way, millions of programmers will lose their livelihood. It's interesting that the "natural reaction" to releasing an open source project, have it be successful, and have some Amazon "steal" it (leave the argument aside, that's how people will feel, big company makes money using the gift) is somehow worse than if you work for Big Company, they pay you, and then later use your code to make billions. Yeah, it's rhymes with people getting mad about pharmacos charging outrageous prices for life saving drugs they developed in order to charge outrageous prices. In both cases (drugs and OSS) it's an ugly process that produces great and greatly uneven value to humanity, but the alternatives are less value overall, even to those on the losing side of the uneven value. >it's an ugly process that produces great and greatly uneven value to humanity That'd be far more believable if it weren't for the fact a vast majority of the research is publicly funded for those drug companies. They have no issues selling their drugs for less money in other markets while still turning a profit. And there's absolutely no indication they'd cease to exist with just outrageous profits, not "crippling entire economies" level profits. The cheapest part of the research is publicly funded. The extreme costs come from taking the outputs of public research and trialing and developing it into a viable drug. Pharma profits also aren’t particularly noteworthy. Their revenues are, because of the ubiquity of their need, but profit margins for Pharma is pretty middle of the road compared to other industries. So I agree with you in that it's ugly, and they do take the lion's share of benefit from public research. That said, the public research doesn't run human trials, scale up, or QC production. Still ugly, still valuable. Seems pretty understandable to me. In the former, you work on something hoping that real people will find it useful. In the latter, you're explicitly doing work for a paycheck. Most open source licenses have strings attached, the terms of the licence say what those “strings” are. Like requiring attribution. That sounds fun. I am trying to find potential employers who need me to write or fix code, and ideally contribute upstream along with it. Any ideas where to start? I am thinking something "chill". I am trying to avoid large corporations. > If you take my gift and profit, it doesn't hurt me My opinion is that it actually hurts everyone when the open source commons are looted for private profits Carmack is wealthy, and will do OK even if every single software-related job is terminated and human-mediated code-generation is relegated to hobby-status. Other people's milages vary. My motivations are very different: the projects I authored and maintained were deliberately all GPL-licensed, my contributions to other OSS are motivated by the desire to help other people - not to an amorphous "world." Correct. And certainly not to people and companies who'd like to use my work to deny end users the rights to control their computing. That's the whole point of the GPL to me. The code I release is not an unconditional gift. It definitely has strings attached on purpose. LLMs completely break this. I'm helping very rich people build the systems they impose to the world and that have awful externalities, and these systems help others build proprietary software. I can't say I'm too happy about this. So, definitely not just for corporations to make insanely massive profits off? How much do you think people would pay for this patch? https://github.com/openssl/openssl/pull/1320 If you had to pay for it seperately, would you include it in anything? And yet, including it everywhere helps people with clients that can't be upgraded. Maybe less now, rsa_dhe is not deployed so much and hopefully windows 8 is also not deployed so much. >I think one of the more prominent issues folks take with mass training on OSS is that the companies doing it are now profiting for having done it. What makes this more objectionable than profiting off open source projects by using it directly? eg. tech giants using linux as a server OS, rather than having to pay microsoft thousands per server for a windows server license? With the original GPL, they don't even have to contribute back any patches. >What makes this more objectionable than profiting off open source projects by using it directly? i can brag if netflix is using my X or facebook runs all their stuff with my Y. that can help me land consulting gigs, solicit donations, etc. This is an edge case in OSS. Even among software packages used by Netflix and Amazon, few of them were attributable to a single maintainer or small group of individuals. They've long since become community developed projects. Netflix and Amazon use many packages of all sizes. And contributions to projects with many contributors helped people get jobs. How would you even know that Netflix or Amazon uses your package? Their open source software depended on or derived from your package. They included your copyright notice with software they distributed. Someone contributed code. Someone reported a bug. Someone requested a feature. Someone mentioned it at a conference. I could continue. More people use Linux, more recognition Linux itself get which directly or indirectly gets some more donations, developers etc. With AI, the link is not clear at all. Its just pure consumption. There is no recognition. > There is no recognition I've never written or contributed to open source code with this being the goal. I never even considered this is why people do it. it has never been my explicit goal. but i have certainly enjoyed the rewards of recognition (e.g. i was able to lean on a successful project of mine to help land a nice consulting gig) and it would be silly to ignore that. (edit: the comment i replied to was edited to be more a statement about themselves rather than a question about other developers, so my comment probably makes less sense now) I worked on several open source projects both voluntarily or for work. The recognition doesn't really need to be financial. If people out there are using what you are building, contributing back, appreciating it -- it gives you motivation to continue working. Its human nature. One of the reason why there are so many abandoned projects out there. I don't dispute your own personal motives, but if it's never been a goal for most people, then CC0 would be more popular than the BSD or MIT license - it's simpler and much more legally straightforward to apply. Competition. Using my open source projects directly doesn't kill my employment. AI company explicitly say they want to put me out of work, using my code aginst me. There is a major difference between open-sourcing a completed product versus being an open source maintainer, and I'm disappointed that Carmack is drawing a false equivalence here. Plus unless I'm wrong he's talking about products that were released several years ago and milked for money already. Isn't that the case, and even the point, of all open source, even before AI? What's the point of a gift if the receiver isn't allowed to benefit/profit from it? For instance, do you think Linus is upset that ~90% of all internet servers are running his os, for profit, without paying him? Of course he isn't, that was the point of the whole thing! Are you upset Netflix, Google, and heck, even Microsoft are raking in millions from services running on Linux? No? Of course you aren't. The original author never expected to be paid. He gave the gift of open source, and what a gift it is! Linus T explicitly licensed Linux under a license that allows anyone to run it but requires people who modify modifications to share those modifications. > but requires people who modify modifications to share those modifications. Not exactly. You can modify Linux and run it yourself all you want without obligation to share your changes. The sharing requirements are more limited and involve distribution. Correct! This is the exact reason anyone who wants to use the os itself as a moat uses FreeBSD as a base instead, and add proprietary modifications to it. FreeBSD also being a open source gift, that does not have those requirements that Linux does. Prominent examples include Sony PlayStation, and Apple OSX. You dont know what GPL is? It's not an unconditional gift, it's got strings attached. AI training on GPL works is basically IP laundering, you're taking the product without paying the asking prices. I do know what it is, I've even read the licence in full! What specific paragraph in the GPL prohibits training of AI on it? I guess it might be a matter of interpretation, but by my reading, it is allowed. Ps. In the future, try to refrain from using demeaning rethorical questions like the one this comment starts with, it only serves to foster toxicity. Please and thank you
Ds. > What specific paragraph in the GPL prohibits training of AI on it? I guess it might be a matter of interpretation, but by my reading, it is allowed. It's not a matter of interpretation - any derivative product is also GPL, and if you don't want the derivative product to be GPL, then don't use the original product. IP as a concept has always been equal parts dystopian and farcical, and efforts to enforce it have become increasingly strained over time. Property requires scarcity. Ideas aren’t scarce. My consumption of an idea is affected by your consumption of an idea. AI has simply increased the intensity of this friction between IP and reality to a degree that it can’t be ignored or patched over any longer. Are you suggesting that authors didn't know or understand that commercial exploitation of their OSS contributions was possible? If so, that is a complete misrepresentation of history. There has always been open-source licenses that disallowed commercial use. Authors have chosen not to use them, and instead chose licenses, such as MIT/GPL, that allowed commercial use. And there has always been commercial use of OSS. Big companies, small companies, tech companies, oil and gas companies, weapons manufacturers, banks, hardware companies, etc. They all use OSS and they all make a profit from it, without giving anything back to the people who originally wrote it. That's not an edge case or an unexpected consequence, it a fundamental tenet of free (as in freedom) software: You do not get to choose who uses it, or how they use it. > There has always been open-source licenses that disallowed commercial use. There were source available licenses against commercial use. Free Software Definition and Open Source Definition said a license must allow any use. This is just the divide between capital and labor though, isn't it? See also: everything is a remix; great artists steal. I'm on both sides. I've contributed to open source. I use AI both in my personal projects now and to make money for my employer. I'm still not sure how I feel about any of it, but to me the bigger problem is the division between capital and labor and the growing wealth inequality divide. > great artists steal. That quote is about inspiration, not just using others' work or style. T. S. Eliot's version from 1920 put it best imho: > Immature poets imitate; mature poets steal; bad poets deface what they take, and good poets make it into something better, or at least something different. The good poet welds his theft into a whole of feeling which is unique, utterly different from that from which it was torn; the bad poet throws it into something which has no cohesion. > profiting for having done it. Isn't that permitted by some of the more popular licences? If you care about others profiting from your work you'd choose an appropriate licence. And then you'd temper your expectations and hope for the best because you know there will be less than perfect compliance. It's like lending money to family or friends. You can hope they pay you back, but better to consider it a gift because there's a good chance they won't. Is it worse because it's AI for some reason? I'm having trouble pinning down exactly what the gripe is. Is it license compliance? Is it AI specific? Is it some notion about uncool behavior in what some people see as a community? > But that doesn't mean they don't care if other people profit from their work This doesn't make sense. You make something and put out there, for free, of your own will. Why do you care if someone takes it and makes a profit? Shouldn't you have taken that profit route yourself before if that's what you wanted? Getting the credit and the modifications is the profit. You basically are looking at a contract and saying you aren't going to agree to the terms but you're taking the product anyway. What seems stranger to me is not acknowledging, that most popular OSS explicitly permitted for profit use. It's essentially what made them popular. Obviously LLMs are new and nobody knew that they would happen. But the part where most popular OSS willfully committed to broad for profit use is not. > I think one of the more prominent issues folks take with mass training on OSS is that the companies doing it are now profiting for having done it. He says it's a gift, and if people do whatever, he doesn't care; he already gave it away. I think it's interesting that nobody would cry that Fabien should shovel cash from his book sales towards Carmack, nor should those who learned how to code by reading source owe something to the authors beyond gratitude and maybe a note here and there. Even things like Apple's new implementation of SMB, which is "code clean" from GPLv3 Samba, but likely still leans on the years and years of experience and documentation about the SMB protocol. > He says it's a gift, and if people do whatever, he doesn't care; he already gave it away. That's his choice and I assume he licensed his code accordingly. That doesn't mean that the choices of others who used different licenses are invalid. It has never been the case that publishing a work entitles you to a share of all profits that are downstream of your work. Copyright law protects your ability to receive profits that result from the distribution of the work itself, but that's quite limited. If you publish a cookbook, you should get a portion of the sales of the cookbook itself, and no one should be allowed to distribute copies of it for free to undermine your sales. What you don't get is a portion of the revenues of restaurants that use your recipes! It's also odd to release software under a license allowing commercial use if the authors didn't want that. > He doesn't acknowledge that Anthropic, OpenAI, etc, are profiting while the original authors are not. How is this different than any company that uses the open source software? I find this argument hard to swallow. If open source contributors want to profit from their code being used and prevent big companies from using it or learning from it, open sourcing it would be an irrational choice. >How is this different than any company that uses the open source software? recognition for the authors, which can lead to all sorts of opportunities. "netflix uses my X for their Y, worldwide" opens doors. Can you cite an actual example of a FAANG company using X for Y that is also primarily attributable to a single developer? That is, someone who can say "uses my X"? Not a community-developed project with a lot of contributors, but a software that would realistically qualify as being mostly attributable to one person? Redis is an easy example, but the author of that doesn't need to say "Netflix uses my X" because the software is popular by itself. AI being trained on Redis code hasn't done anything to diminish that, as far as I can tell. >Can you cite an actual example of a FAANG company using [...] FAANG specifically? no, i am not familiar with their entire tech stacks. but i have leaned on my single-developer projects (being used in other, not owned by me, software) to help land consulting gigs. A lot of the use of open source code has directly breached the terms under which that code is shared and they are now monetising the sale of this code. > But that doesn't mean they don't care if other people profit from their work. He clearly states his opinions. He doesn't care if other people profit from his code. >> GPL would prevent outright exploitation by our competitors, but those were to allay fears of my partners to allow me to make the gift He believes other members in OSS community should have this mindset. Of course it might not be fair, especially for members who are as financially fortunate as him. His point is clear nevertheless. Its a lot less odd when you remember that he's running an AI company himself. I'm seeing your comment's downvoted, I'd like to hear from those that did as to why. Doesn't his current venture with his AGI startup Keen Technologies deserve being called out as a potential conflict of interest, here? Because whether there is a conflict of interest or not, the argument can and should be examined on its own merits. Ah.. So the old “It is difficult to get a man to understand something, when his salary depends upon his not understanding it!”. Yes, but likely in the exact inverse than what is implied here. Carmack has generational wealth, he is likely fine financially regardless of how AI pans out. The many individuals who feel they should be financially compensated for code they open sourced are likely far more invested financially in that particular outcome. That's the point? I agree and roughly it's one of two. A: you made this as a free gift to anyone including openai
B: you made this to profit yourself in some way The argument he makes is if you did the second one don't do opensource? It does kill a ton of opensource companies though and truth is that model of operating now is not going to work in this new age. Also is sad because it means the whole system will collapse. The processes that made him famous can no longer be followed. Your open source code will be used by countless people and they will never know your name. It's not called a distruptive tech for nothing. Can't un opensource all that code without lobotomizing every AI model. It's not even the profit, but that there is often no new code being contributed. AI provides an offramp for people to disengage from social coding. People don't see the point because they still don't understand the difference between barely getting something to work and meaningfully improving that thing with new ideas. if no code is contributed back then why is there an ongoing problem with massive amounts of PRs? I didn't say slop. I said code. The whole point of contributing to open source is to make decisions and the code is the medium. If folks don't want LLMs scanning their codebases we should just make some new OSS licenses. Basically, "GPL/BSD/MIT + You pinky promise not to scan this for machine learning". Either it works and the AI makers stop stop slurping up OSS or it doesn't hold up in court and shrinkwrap licenses are deemed bullshit. A win/win scenario if you ask me. I haven't given a cent to openai or anthropic but they have given me many thousands of tokens for free. >I think one of the more prominent issues folks take with mass training on OSS is that the companies doing it are now profiting for having done it. I've noticed this thing where people who have decided they are strongly "anti-AI" will just parrot talking points without really thinking them through, and this is a common one. Someone made this argument to me recently, but when probed, they were also against open weights models training on OSS as well, because they simply don't want LLMs to exist as a going concern. It seems like the profit "reason" is just a convenient bullet point that resonates with people that dislike corporations or the current capitalist structure. Similarly, plenty of folks driving big gas guzzling vehicles and generally not terribly climate-focused will spread misinformation about AI water usage. It's frankly kind of maddening. I wish people would just give their actual reasons, which are largely (actually) motivated by perceived economic vulnerability. Carmack is the same person comfortable with delaying talks of ethical treatment of a digital being, or what even constitutes one until in his eyes "they demonstrate the capabilities of a two year old" by which point, with the scale we distribute these models at, and the dependence we're pushing the world to adopt on them, we'll be well into the "implicit atrocity zone", and so far down the sunk cost trail, everyone will just decide to skip the ethics talk altogether if we wait that long. This is in spite of being a family man, which raises serious questions to me about how he must treat them. It does not surprise me at all the man has blindspots I could fit a semi-truck in. In my mind, AI is making a lot of engineers, including Carmack, seem fairly thoughtless. At the other moments in recent history where technology has displaced workers, labor has either had to fight some very bloody battles or had stronger labor organization. Tech workers are highly atomized now, and if you have to work to live, you're negotiating on your own. It seems like Carmack, like a lot of tech people, have forgotten to ask the question: who stands to benefit if we devalue the US services economy broadly? Who stands to lose? It seems like a lot of these people are assuming AI will be a universal good. It is easy to feel that way when you are independently wealthy and won't feel the fallout. Even a small % of layoffs of the US white collar work force will crash the economy, as our economy is extremely levered. This is what happened in 2008: like 7% of mortgages failed, and this caused a cascade of failures we are still feeling today. Software engineers have been automating away workers' jobs from the beginning. "Computer" was once a job title. There were armies of switchboard operators at the phone company. Companies had typing pools, mail clerks, and file clerks. We write shell scripts and development tools to automate our own jobs. Most of us got into engineering for the means (programming computers) rather than the ends (automating away jobs). I guess the people that have been rejoicing from the AI revolution are of the latter type. Or maybe they find the idea of computers that can think just as exciting as you found programming at the start of your career? Maybe Carmack is just better informed or more forward-thinking. The BLS is still predicting software jobs will increase by 15% over the next decade. Currently software job postings on Indeed are up 11% YoY. Yeah mass media and some CEOs looking for an excuse are telling you that AI is a reason for doing layoffs. Both groups have reasons to lie to you and lie to the public regularly. Maybe they're lying again here? I employ software engineers and I am one. Over the past 12 months I've become very forward looking on AI because it's gotten really good. If you work for me, part of your job is to maintain an .agents/ folder in every repo with prompts and context so that the models can do code reviews, draft PRs for your consideration, assist with specs and tests, you name it. The better your prompts and context, the better your bots. Everyone on the team is able to achieve more because of this. This is an incredible time to be a software engineer. None of this makes me want to let go of anyone. Maybe that makes sense for a company that's in a profit-taking, product-enshittifying mindset. But for the rest of us... are you kidding? There's so much that could be built and if a company is stagnant and enshittifying instead of improving its products, I just want to use this new productivity to eat their lunch and grow. The models make it possible for us to write more tests and have more thorough acceptance criteria, for example. And we never did as much human code review as I wanted - adding agents to help with parts of it is closing that gap and results in more issues being found sooner, more items going into the backlog, and better overall quality being shipped. Human + AI model complementing each other absolutely is more productive than either one working alone, many places don't understand this yet but eventually they'll figure it out or die. I admit to being conservative about hiring new people right now because the job is changing so much. But once we fine tune the new best practices I think hiring is only going to accelerate. I definitely have no interest in letting someone go. I guess 25 years of "unions are for under-performers" is finally going to bite us in the ass. I'm not aware of any labor efforts that have successfully fought automation long term. There's been plenty of temporary victories, but even the unions often acknowledge it's temporary. The point is not to fight automation. The point is to fight for a better distribution model. Well you are still right though. There were only temporary wins. > in recent history where technology has displaced workers, labor has either had to fight some very bloody battles or had stronger labor organization what examples are you thinking of? Most of 19th and early-20th century history, which is very much recent history. Look up: - The Haymarket Affair - The Homestead Strike - The Triangle Shirtwaist Factory Fire - The Ludlow Massacre - The Battle of Blair Mountain You could also simply have taken the quote you were responding to and run it through a few LLMs to acquire those examples. lol this got downvoted - sorry that I studied history! > You could also simply have taken the quote you were responding to and run it through a few LLMs to acquire those examples. Wasn't me, but probably because this was unnecessary and rude. An example, or a link, when a claim is made, is always nice, turns a hollow claim into something informative. Better signal to noise is nice. That’s funny. I find it pretty rude to ask a question on a fairly well-documented historical topic that you could also very easily have found out with a simple Google search. Back in the day, we used to reply to people, “Let me Google that for you,” when someone asked such a low-effort question. Your original reply strongly indicated that you were skeptical and questioning the user’s claim. There is a very large body of historical research documenting all of these things. nomel couldn't have downvoted you (HN constraint), stop the attack. LMGTFY has a terrible rep on HN (I'd link a search, but you can easily find). I think my definition and your definition of what constitutes an attack are fairly different. I’m offering feedback, not an attack. > Even a small % of layoffs of the US white collar work force will crash the economy, as our economy is extremely levered. A major economic crash as the only consequence would be the good ending. The real societal risk here is that software development is not just a field of primarily white men, it was one of the last few jobs that could reliably get one homeownership & an (upper) middle class life. And the current US government is not, shall we say, the most liberal. There is a substantial risk that when forced with the financial destitution of being unemployed while your field is dying, people will radicalize. It takes a good amount of moral integrity to be homeless under a bridge and still oppose the gestapo deporting the foreigners who have jobs you'd be qualified for. And once the deportations begin, I doubt they'll stop with only the H1Bs. The Trump admin's not exactly been subtle about their desire to undo naturalizations and even birthright citizenship. I totally agree. I've written about this topic a lot on this site, probably most recently here: https://news.ycombinator.com/item?id=47115597 The US is built on-top of a high value service economy. And what we're doing is allowing a couple companies to come in, devalue US service labor, and capture a small fraction of the prior value for themselves on top of models trained on copyrighted material without permission. Of course, to your point: things can get a lot worse than that. I honestly don't think a lot of executives even know how much they're shooting themselves in the foot because they seem unable to think beyond the first order. I also see a lot of top 1% famous or semi-famous engineers totally ignoring the economic realities of this tech, people like: Carmack, Simon Willison, Mitchell Hashimoto, Steve Yegg, Salvatore Sanfilippo and others. They are blind to the suffering these technologies could cause even in the event it is temporary. Sure, it's fun, but weekend projects are irrelevant when people cannot put food on the table. It's been really something to watch them and a lot of my friends from FAANG totally ignore this side. It is why identity matters when people make arguments. I also think I'm insulated partially from the likely initial waves of fallout here by nature of a lucky and successful career. I would love it if the influential engineers I mentioned above stopped acting like high modernists and started taking the social consequences of this technology seriously. They could change a lot more minds than I could. And they could ensure through that advocacy for labor that we see the happiest ending with respect to rolling out LLMs. Unfortunately I don't really believe labor has much teeth anymore, and tech will wake up too late to do anything about it. > I honestly don't think a lot of executives even know how much they're shooting themselves in the foot because they seem unable to think beyond the first order. It's just so depressing. You see Microsoft and Google's CEOs being completely reckless with investment & the economy. And it's just ... HAVE THEY NOT LOOKED INTO A MIRROR? DO THEY NOT REALIZE THEY ARE THE FALL GUYS?! Nevermind how the vast majority of major CEOs can't even run a business anymore. An old boys club of morons running the entire economy. > And they could ensure through that advocacy for labor that we see the happiest ending with respect to rolling out LLMs. It's just more of the same old "Software dev doesn't need unions". The top 1% always think they're pointless because they made it without unions. > Unfortunately I don't really believe labor has much teeth anymore, and tech will wake up too late to do anything about it. Amusingly, I hold the opposite sentiment. Labor isn't going anywhere. These executives and managers can barely tie their own shoelaces. Big Tech and the current startup scene are laughably dysfunctional. The moment the economic recession really starts to set in, everyone's gonna try to cut down their SaaS spending. Then, the days of being able to shit out some (AI or not) slop and charge double price will be well and truly over. Once software firms have to compete on quality again, labor is going to be more important than ever. AI may not even be meaningfully involved in software dev. To break even at the API prices would require charging on the order of 1-2 thousand dollars, per month, per seat. Factoring in long term training costs will will make that several times worse. ... Before we consider that we're probably heading into an oil crisis making energy and computer hardware much more expensive. I doubt employers are going to pay the $10,000/month/seat required to make AI profitable for everyone in the supply chain. Certainly not during the worst recession this side of WWII. This is because Carmack doesn't really do OSS, he just does code dumps and tacks on a license ("a gift"). That's of course great and awesome and super nice, but he's not been painstakingly and thanklessly maintaining some key linux component for the last 20 years or something like that. It's an entirely different thing; he made a thing, sold it, and then when he couldn't sell more of it, gave it away. That's nice! But it's not what most people who are deep into open source mean by the term. > This is because Carmack doesn't really do OSS, he just does code dumps and tacks on a license ("a gift"). That is, in fact, OSS. Open source does not mean, and has never meant, ongoing development nor development with the community. That’s just incorrect. “Open source” can mean the licensing as well as the development model [0]. It certainly has been associated with the development model since The Cathedral and the Bazaar [1]. [0] https://en.wikipedia.org/wiki/Open-source_software_developme... [1] https://en.wikipedia.org/wiki/The_Cathedral_and_the_Bazaar > “Open source” can mean Keyword being "can" The Wikipedia page you linked to refers to "Open-source software development (OSSD)" which implies that it's a different concept than "open source" by itself You and Bigstrat2003 are arguing a technicality, and you're technically correct, but in context I think that's somewhat beside the point. Skrebbel and Layer8 are focused on the cultural associations of "open source" development, and this mismatch is causing everyone to talk past each other. The original post in this thread was: > This is because Carmack doesn't really do OSS, he just does code dumps and tacks on a license ("a gift"). That's of course great and awesome and super nice, but he's not been painstakingly and thanklessly maintaining some key linux component for the last 20 years or something like that. It's an entirely different thing; he made a thing, sold it, and then when he couldn't sell more of it, gave it away. That's nice! But it's not what most people who are deep into open source mean by the term. Skrebbel probably shouldn't have said that Carmack "doesn't really do OSS", but what they clearly meant was, Carmack doesn't participate in the sort of community development as the Linux kernel or Apache or whatever. More succinctly, Carmack only contributes his code to OSS, but not his time, and shouldn't impose his values on the wider community that contribute both. > technically correct, but in context I think that's somewhat beside the point Talking past people to argue on semantics and pedantry is a HN pastime. It may even be it's primary function. Code gifted absolutely includes the time taken to write it. case in point As pointed out in the OP comment, it's basically 'money for jam' by the point he releases the source code: > It's an entirely different thing; he made a thing, sold it, and then when he couldn't sell more of it, gave it away. That's nice! Carmack has extracted as much profit as he could care for from the source code. The releasing of the code is warm fuzzy feelings for zero cost, while keeping it closed source renders zero benefit to him. >“Primary” function If that was the intent don’t you think it would be stated somewhere, or in the faq? >“Talking” past It’s only text, there’s no talking past. You can’t talk past someone when the conversation isn’t spoken. At best, you might ignore what they write and go on and on and on at some length on your own point instead, ever meandering further from the words you didn’t read, widening the scope of the original point to include the closest topic that isn’t completely orthogonal to the one at hand, like the current tendency to look for the newest pattern of LLM output in everyone’s’ comments in an attempt to root out all potential AI generated responses. And eventually exhaust all of their rhetoric and perhaps, just maybe, in the very end, get to the I’m saying that “open source” can mean both things. The parent was arguing that it only means the licensing. I’m not arguing that it always means the development model. > The Wikipedia page you linked to refers to "Open-source software development (OSSD)" which implies that it's a different concept than "open source" by itself By that logic, “open source licensing” would also imply a different concept than “open source” by itself. Note that the Wikipedia page for “open-source software” [2] states: “Open-source software is a prominent example of open collaboration, meaning any capable user is able to participate online in development, making the number of possible contributors indefinite”. That would really only be the case in the context of open-source development. > By that logic, “open source licensing” would also imply a different concept than “open source” by itself. It does Isn't Carmack just employing the 'Cathedral' type of 'Open Source'? The “cathedral” model refers to closed-source development: https://en.wikipedia.org/wiki/Open-source_software_developme... Appending ‘development’ seems like a significant departure from ‘vanilla’ “Open Source” to me, and wouldn’t all development be ‘closed-source’ at least between commits, if not between pull requests? See https://opensource.org/about/history-of-the-open-source-init... under ‘Coining “Open Source”’: The conferees believed the pragmatic, business-case grounds that had motivated Netscape to release their code illustrated a valuable way to engage with potential software users and developers, and convince them to create and improve source code by participating in an engaged community. The conferees also believed that it would be useful to have a single label that identified this approach and distinguished it from the philosophically- and politically-focused label “free software.” From the beginning it was about promoting the model of developing software in an open community. The licensing is a means to that, but the motivating idea is to have open-source development. And Netscape’s release of the source code, what lead to Mozilla, was prompted by the “bazaar” ideas presented by RMS. I think you have confused RMS (Richard Stallman) and ESR (Eric S. Raymond). It was ESR that coined and popularized the cathedral and bazaar development analogy and terminology. It was also ESR who was at the conference your comment is discussing. RMS is “free software”, copyleft, and GNU. ESR is “open source” and the author of ‘The Cathedral and the Bazaar”. Of course, I could have misunderstood your comment, if so, mea culpa and feel free to ignore. The 'bazaar' system is a wonderful methodology, but there is a place for the 'cathedral', and it is no less open source. I was arguing against this statement: "Open source does not mean, and has never meant, ongoing development nor development with the community." It is simply false that it has never meant that. While you can have a cathedral-like development and publish it under an open-source license, that's not what RMS was talking about in his essay. I'm also not arguing about what is good or bad, but about what was meant by the term "open source" when it was introduced, and how it is still understood by many people since then. SQLite being a prime example of cathedral-style development that few would argue isn’t open source.
arjie - 12 hours ago
Aurornis - 11 hours ago
malfist - 10 hours ago
muyuu - 2 hours ago
arjie - 10 hours ago
zahlman - 9 hours ago
arjie - 7 hours ago
bcrosby95 - 7 hours ago
rurp - 10 hours ago
socalgal2 - 10 hours ago
Suppafly - 35 minutes ago
johnisgood - 7 hours ago
bluefirebrand - 5 hours ago
01HNNWZ0MV43FF - 2 hours ago
safety1st - 37 minutes ago
acuozzo - 11 hours ago
Aurornis - 9 hours ago
acuozzo - 3 hours ago
jltsiren - 11 hours ago
crote - 11 hours ago
ThrowawayTestr - 10 hours ago
necovek - an hour ago
Aurornis - 9 hours ago
raincole - 9 hours ago
adiabatichottub - 11 hours ago
em-bee - 12 hours ago
dartharva - 11 hours ago
crote - 11 hours ago
em-bee - 10 hours ago
pjmlp - 11 hours ago
logicchains - 11 hours ago
registeredcorn - an hour ago
rconti - 11 hours ago
OSaMaBiNLoGiN - 12 hours ago
toast0 - 12 hours ago
Jare - 12 hours ago
liuliu - 11 hours ago
overfeed - 9 hours ago
pseudalopex - 12 hours ago
Jare - 11 hours ago
pseudalopex - 7 hours ago
johnmaguire - 12 hours ago
skeledrew - 12 hours ago
johnmaguire - 12 hours ago
skeledrew - 11 hours ago
wat10000 - 8 hours ago
CamperBob2 - 12 hours ago
crote - 10 hours ago
CamperBob2 - 8 hours ago
johnmaguire - 12 hours ago
hamdingers - 11 hours ago
CamperBob2 - 8 hours ago
_DeadFred_ - 12 hours ago
GeoAtreides - 12 hours ago
skeledrew - 12 hours ago
CamperBob2 - 12 hours ago
anonymousab - 12 hours ago
dminik - 7 hours ago
bombcar - 12 hours ago
j-bos - 12 hours ago
tw04 - 12 hours ago
NeutralCrane - 9 hours ago
j-bos - 12 hours ago
fwip - 10 hours ago
emigre - 8 hours ago
johnisgood - 7 hours ago
bluefirebrand - 11 hours ago
overfeed - 11 hours ago
jraph - 10 hours ago
bluefirebrand - 9 hours ago
toast0 - 11 hours ago
gruez - 12 hours ago
john_strinlai - 12 hours ago
Aurornis - 12 hours ago
pseudalopex - 12 hours ago
Gud - 11 hours ago
pseudalopex - 10 hours ago
truncate - 12 hours ago
nomel - 12 hours ago
john_strinlai - 12 hours ago
truncate - 11 hours ago
Qwertious - 9 hours ago
alwaysbeconsing - 7 hours ago
evrimoztamur - 12 hours ago
truncate - 12 hours ago
amarant - 12 hours ago
tuna74 - 12 hours ago
Aurornis - 12 hours ago
amarant - 12 hours ago
lelanthran - 12 hours ago
amarant - 9 hours ago
lelanthran - an hour ago
NeutralCrane - 9 hours ago
sobiolite - 12 hours ago
pseudalopex - 12 hours ago
js2 - 12 hours ago
alpaca128 - 11 hours ago
tejohnso - 3 hours ago
skeledrew - 12 hours ago
lelanthran - 12 hours ago
jstummbillig - 12 hours ago
bombcar - 12 hours ago
sumeno - 12 hours ago
emtel - 11 hours ago
sowbug - 12 hours ago
Aurornis - 12 hours ago
john_strinlai - 12 hours ago
Aurornis - 12 hours ago
john_strinlai - 12 hours ago
PaulKeeble - 12 hours ago
raincole - 9 hours ago
boredtofears - 12 hours ago
barrowclift - 12 hours ago
NeutralCrane - 9 hours ago
Findecanor - 12 hours ago
NeutralCrane - 9 hours ago
johnsmith1840 - 12 hours ago
sublinear - 12 hours ago
dahrkael - 12 hours ago
sublinear - 11 hours ago
ryandvm - 12 hours ago
ThrowawayTestr - 10 hours ago
supern0va - 12 hours ago
salawat - 12 hours ago
SirensOfTitan - 12 hours ago
skybrian - 4 hours ago
sph - 2 hours ago
esperent - 12 minutes ago
safety1st - 15 minutes ago
ryandvm - 12 hours ago
nitwit005 - 10 hours ago
markus_zhang - 7 hours ago
nomel - 12 hours ago
_doctor_love - 11 hours ago
_doctor_love - 9 hours ago
nomel - 8 hours ago
_doctor_love - 8 hours ago
gnabgib - 8 hours ago
_doctor_love - 8 hours ago
SlinkyOnStairs - 12 hours ago
SirensOfTitan - 11 hours ago
SlinkyOnStairs - 8 hours ago
skrebbel - 12 hours ago
bigstrat2003 - 12 hours ago
layer8 - 11 hours ago
Aurornis - 11 hours ago
Wowfunhappy - 8 hours ago
aeonfox - 6 hours ago
Aeolun - 4 hours ago
bradleykingz - 4 hours ago
aeonfox - 2 hours ago
ineedasername - 5 hours ago
layer8 - 11 hours ago
Aurornis - 10 hours ago
nickff - 11 hours ago
layer8 - 11 hours ago
nickff - 11 hours ago
layer8 - 11 hours ago
throwaway17_17 - 4 hours ago
nickff - 8 hours ago
layer8 - 7 hours ago
tonyarkles - 6 hours ago