Thanks for posting here. This information is helpful.
I strongly encourage you to provide that information on the page asking for donations. Even if it's just one sentence with a link and even if it doesn't fit with Mozilla's corporate policies.
I just tried Zed with Gemma 4 to see how it does with local models. Impressive speed and quality for the small model with thinking off (E4B). Very slow for the big model with thinking turned on. We'll see if this is better than my current tools (primary is Codex CLI plus qwen3 coder next) but the first impression is good. Especially nice that it configured all of my ollama models automatically.
I've been using Thunderbird for decades, I've donated in the past, and am likely to donate again. With that out of the way, the lack of transparency as to what happens to my money kills the incentive to donate.
"How will my gift be used?"
"Thunderbird is the leading open source email and productivity app that is free for business and personal use. Your gift helps ensure it stays that way, and supports ongoing development."
Well that tells me exactly nothing. This might not be as big an issue if they were separate from Mozilla. To be concrete, and focusing only on the development of Firefox, there's now an AI chatbot in the sidebar. I think that's a good addition. However, when the only options are proprietary services, it's hard for me to see the point of Firefox. It would be easier to get out my credit card for Thunderbird if I didn't have those thoughts in the back of my mind. As it stands, my donation might be going to fund the Mozilla CEO's salary.
I find that a weird sentiment. Why do people demand to know and control how every one of their donations goes, while nobody questions how corporations use their money. Ironically, the demand for this increased transparency significantly increases compliance cost, which means more and more money is driven away from the actual cause toward the administrative costs. Exactly what people don't want to support.
The defining difference about paying money to a corporation in exchange for a product is you're paying for something already there, an agreed exchange of value. The whole point about a donation is it's given not in exchange for doing any particular task, but gratuitously.
It's not a weird sentiment to want to know what benefits a gift is providing. That's all people are asking for when they want transparency around donations: tell us how you're benefiting from it so we can feel good about gifting you.
Is it necessary? No. The point being made is that people would be happier and potentially gift more if there was more transparency. If your argument is transparency costs more than the extra gifts then the solution to that is - ironically - be transparent about it and people might gift means to make transparency cheaper and make donations viable.
If Thunderbird required users to sign up for an annual subscription, then that specific problem -- not being able to tell what good one's payment would do -- would go away. There would be a very specific reason to pay the money.
(In practice, they presumably couldn't do that, at least not effectively, because the code is open source and someone else could fork it. But let's imagine that somehow they could require all Thunderbird users to pay them.)
That doesn't, of course, mean that it would be better overall. Thunderbird users would go from getting Thunderbird for free and maybe having reason to donate some money, to having to pay some money just to keep the ability to use Thunderbird: obviously worse for them. There'd probably be more money available for Thunderbird development, which would be good. The overall result might be either good or bad. But it would, indeed, no longer be unclear whether and why a Thunderbird user might choose to pay money to the Thunderbird project.
> Instead, people act like they're buying in to a 50% share with their $5 and then act like they cofounded the project forever after the donation.
You've twisted the timing. My comment is about
"Give me money." "Okay, tell me why I should give you money."
not
"I gave you money. Tell me what you did with it." It's a big difference. It's easy for me to just not give them money if I don't know what I'm donating to.
Those two examples map to the first and second parts of my claim.
Though I'm making a general reflection rather than trying to antagonize any individual here. I was already thinking about this when clicking into TFA to see that yes, it's another donation beg.
The answer to the person I replied to is basically: yes.
There's a nit in human psychology between mutual transactions (even lopsided against our favor) and voluntary unilateral ones (like donations) where the latter results in disproportionate scrutiny and entitlement compared to the former.
I once started accepting donations on my forum. I noticed people acted like they were about to make the grandest gesture in the world, would I be so lucky to deserve it after answering their questions despite having built a forum they spend four hours a day on. (They gave me $5)
And once they donated, they saw themselves as a boardmember-like persona with veto power and a disproportionate say on what I do, often pointing out that they're a donor. (They gave me $5)
I'm exaggerating a bit to paint a picture of what I mean. I think it's all unintentional, and they might be embarrassed if I'd told them this.
But I ended up refunding everyone after a while.
Yet when I charged $5 to let users expand their PM inbox size or max avatar resolution, nobody ever brought it up. They understood the transaction ended there. What is the $5 used for? -- What do you mean? It doubled my PM inbox size.
It's a funny quirk of our brain. I think a license purchase aligns expectations much more than groveling for donations, and it creates a natural freemium model for open source (or source-available rather?) projects.
US nonprofits are as transparent as can get. Their tax returns have to be public record by law. Maybe a press release shared to Hacker News doesn't have the information you want, but you can call them up any time you please and get a detailed categorized line items of everything they spend money on, or use any number of aggregator services that publish IRS Form-990s for free on the web. You can also get it directly from the IRS itself, which has a searchable database. Here is Mozilla's tax return for 2024: https://apps.irs.gov/pub/epostcard/cor/200097189_202412_990_...
> It's not a weird sentiment to want to know what benefits a gift is providing.
"I bought you tickets for your favorite artist for your birthday. I expect a detailed trip report" :)
Yes, you're right, personal gifts aren't donations, but then maybe we should stop calling donations gifts, too. Gifts are given without any expectations attached. Donations do and should have expectations.
When you're shopping for a paid product, you're generally trying to minimize your costs (while balancing quality). When you're donating to a free product, you're actually trying to maximize the effectiveness of your donation. If you were simply trying to minimize your cost/benefit ratio, you would donate nothing. Clearly there is a totally different mentality at play.
Consider it also from the recipient's perspective. Their benefactors are more likely to donate more money when they believe it will be put to good use. It's a complicated messaging problem, but being vague is probably not in your best interest.
Exactly. I decided to never donate to Wikipedia again after learning that wikipedia took some of that donated money and redonated it to other companies.
It felt like a betrayal to me.
Not that I think the other companies were bad, but if they have so much money they're giving it away to other people then they obviously don't need my money anymore.
If they wanted people to give other companies money then why didn't they have a separate different begging drive for those companies instead of just deciding, "Well, this is my money now, given to me to keep the site running and our employees paid, I'm going to give it away instead of using for the purpose that I literally begged it for".
The reason "nobody questions how corporations use their money" is that in 99.9% of cases when I pay a corporation money for a product, I'm doing it not for the sake of what they can do with the money, but because otherwise I don't get to use the product, at least not legally.
If instead I donate to an open-source project, I'm not doing it in order to get access to the product; I already have that. I'm doing it because I hope they will do something with the money that I value. (Possible examples: Developing new features I like. Rewarding people who already developed features I liked. Activism for causes I approve of. Continuing to provide something that benefits everyone and not just me.)
And so I care a lot what they're going to do with the money, in a way I don't if I (say) pay money to Microsoft in exchange for the right to use Microsoft Office. Because what they're going to do with the money determines what point there is in my giving it.
Sometimes, everything the project does is stuff I think is valuable (for me or for the world). In that case I don't need to ask exactly what they're doing. Sometimes, it's obvious that what happens to the money is that it goes into the developer's pockets and they get to do what they like with it. In that case, I'll donate if the point of my donation is to reward someone who is doing something I'm glad they're doing, and probably not otherwise.
In the case of Thunderbird, it's maybe not so obvious. Probably the money will go toward implementing Thunderbird features and bug fixes, but looking at the history of Firefox I might worry that that's going to mean "AI integrations that actual users mostly don't want" or "implementing advertising to help raise funds", and I might have a variety of attitudes to those things. Or it might go toward some sort of internet activism, and again I might have a variety of attitudes to that depending on exactly what they're agitating for. Or maybe I might worry that the money will mostly end up helping to pay the salary of the CEO of Mozilla. (I don't think that's actually possible, but I can imagine situations where Mozilla wants some things done, and if they can pay for them via donations rather than using the company's money they'll do so, so that the net effect of donating is simply to increase Mozilla's profits.)
And I don't think anyone's asking for anything very burdensome in the way of transparency. Just more than, well, nothing at all which is what we have at the moment. The text on the actual page says literally nothing beyond "help keep Thunderbird alive". The FAQ says "Thunderbird is the leading open source email and productivity app that is free for business and personal use. Your gift helps ensure it stays that way, and supports ongoing development." which tells us almost nothing. And "MZLA Technologies Corporation is a wholly owned for-profit subsidiary of the Mozilla Foundation and the home of Thunderbird." which tells us that donations go to a for-profit subsidiary of the Mozilla Foundation (which I believe is the same entity that owns the Mozilla Corporation, but like most people I am not an expert on this stuff and don't know what that means in practice about how the Mozilla Foundation, the Mozilla Corporation and MZLA Technologies Corporation actually work together).
Maybe donated money will lead to MZLA Technologies Corporation hiring more developers or paying existing developers more? Maybe it'll be used to buy equipment, or licences for patented stuff? Maybe it'll be used to advertise Thunderbird and get it more users? Maybe it'll be used to agitate for the use of open email standards or something like that? Maybe. Maybe some other thing entirely. There's no way to get any inkling.
This in a larger perspective at least, IS a problem for NGO:s from what i know. That donors seems to be much more careful where they money go when its in the form of a donation. I dont know about open source project specifics here. I totally get what you mean and probably mostly agree as well, but the money you give to corporations have consequences as well. You can for example fund a company you have strong moral disagreements with without knowing or miss a company that you would want to support for the opposite reasons.
With that said I also think we should expect more then "it helps fund the development". Its not that difficult to write a couple paragraphs more and be a little more specific. Then again, maybe they get so little in donations that they cant really say how the money will be used and its more of a "buy me a beer" type of thing to keep the developers happy. Unless suddenly people start giving more and a developer actually could invest more hours in the project.
Mozilla and Wikipedia for example are causes I support. But why would I give money to them if they are going to turn around and give money to some cause I don't support (OR am actively against)? These non-profits love to shuffle money around to unrelated causes. As a non profit, supporting open source software, I think expecting a large percentage of the donation to go to engineering and not admin, social causes, etc. is a reasonable expectation.
Yes that's all reasonable but the comparison is paying for (or giving them other revenue) corporations who also love to shuffle money around and can support causes you are actively against. The point being made was that people give causes trying to improve society more scrutiny than they give for-profit mega corporations who have in the past shown that they use their money for a lot of things detrimental to society.
Assuming there is a healthy market, then you have alternatives you can purchase your products and goods from. These alternatives may have other trade-offs and in fact, there may well be open and closed alternatives as well as hybrid options.
Some people simply want the "best fit" solution for a product. IMO, this used to be Outlook+Exchange, hands down... M365 scaling has enshittified the bundle in a lot of ways leaving a wide gap for alternatives. Google's GMail is a leading alternative that is a closed service. Thunderbird is an open solution that solves part of the problem (shared calendars/contacts only having half the solution).
When you pay for a product, you often are able to give feedback and request for features... the expectation is that you are getting value for what you are paying and that the company continues to do so while adding features that add more value in time.
When you donate to an open-source project, and that project redirects funds to have a multi-million dollar marketing event that only benefits middle managers and seeks to add revenue with features the majority of donors oppose, then someone who would otherwise support the development might rightly feel a bit betrayed or choose not to donate altogether, much like someone might not purchase a given product or service from a company that does what they feel are bad things.
It's not dramatically different, it's just when/where the individual might expect a level of transparency, value or direction. A purchase is against existing value... a donation is against future value.
I think we're talking past each other. I am not saying that people shouldn't be upset that if they donate to an organization that a large portion of that money might go to things they rather that organization not do. Like a $100 donation might have $20 of overhead or waste.
What I don't get is why people don't think the same for for-profit enterprises. If I spend $120 a year on some SaaS, I don't ask what portion of that goes into the CEOs pocket who might use that money to buy politicians to advance tax policy they prefer, or government contracts against the public interest, etc.
It's not about the expected value of a product, it's about what else your money funds when you hand it over to a corporation that people rarely consider. They should consider it just as much as they consider donations to non-profits.
Also, the assumption of a healthy market is not one I would take. A lot of corporate money is spent on regulatory capture and other ways to prevent a healthy market. Funded by customer spend. A purchase is against future value in the same way that past purchases are what allow companies today to make markets less healthy.
While I get what you're saying, I think it's exactly in that the expectations are different between a donation and a payment for product/service.
You pay for an existing product/service and expect that product/service to be fit for a need... that's generally it as far as expectations go... some may actually care about a company being a bad actor and boycott etc, but that's secondary in and of itself. You immediately get the product or service that exists.
A donation, is against expectations for results... though there may be other reasons to donate to a cause/charity.
When the product is in dire state but the company does unnecessary things and increase CEO salary YoY with ever declining userbase, yes... Maybe the people who donates want to know. Am talking about Firefox there BTW. So it's absolutely understandable that people want to know.
For that matter, Mozilla pretty much left Thunderbird to die off for over a decade... it was a group of committed contributors that kept it alive... Moz now wants to try to monetize the software in a way to support the larger org. Moz.org has been problematic and antithetical to just making great software and you can agree or disagree with their stated goals and where/how they spend their money, but most people would also agree that they're probably spending too much outside the core competency, which should be building great software.
Firefox should have a war chest worth of cash at hand, if it hadn't been spent on massive layers of managers and marketers. They've tried repeatedly to spin off monetization in order to increase the overall charity, and I can understand that desire... but they've done so to levels that absolutely compromise the core of what the org is known for... the software.
They effectively HAD electron decades before electron.. they left it unsupported and let it die... they HAD a great mail/nntp platform, they left it to die and only recently realized it was a thing and tried to resurrect it only as a potential for more monetization. They HAD an engineering staff that was reshaping the direction of low-level development (Rust and related) and they let them all go so they could keep paying middle-managers and marketeers for a charity that was never self-sufficient and only served to drain or monetize their core products to detrimental effect.
I would like Mozilla to have great products and succeed... but frankly, I don't like the parent org, charity structure or their direction at all. They're the worst examples of "woke HR" you can find online and I emphatically won't be giving them cash... I truly hope that at some point the developers can just spin off the open-source itself into a new org similar to Libre Office, and break away. If all they did was the software and their existing monetization, they'd have all of their developer staff and a long headroom of funding in the bank.
Investors do very much question how corporations use their money, and that is why corporations publish quarterly financial statements and have shareholder meetings and hire accountants and auditors. Investors want to make sure that they're going to get their investment back plus profit and thus care about a company's balance sheet. Any financial transparency in non-profit donations is derived from the financial transparency required by for-profit investments.
When making purchasing decisions lots of people look beyond the utility of the product to the broader behaviour of the corporation and how it impacts society. I know people who've been avoiding Nestlé for decades.
When I pay money to buy food I don't need to ask how the shop is going to use that money: I gave money, I got food.
If I am going to donate money to a company/NGO that wants to buy food for poor people, of course I am interested in knowing how much of that money is going to salaries, how much into activities of sort, and how much in actually feeding people.
> Ironically, the demand for this increased transparency significantly increases compliance cost, which means more and more money is driven away from the actual cause toward the administrative costs.
I disagree.
If you are asking people for donations, then it is only fair that you provide transparency.
Donations are made out of pure goodwill. It is not like buying a widget from $megacorp.
I do not buy the "increased administrative costs" argument either. At a bare minimum all it would take is 5 minutes a month and a simple spreadsheet.
Well for one, when you purchase something from a corporation, you know where the money went because you got the thing or access to the service you just paid for. With a donation you don't have that and because you're donating you probably care about whatever subject you want to improve so you'd like to know that is were your money is going instead of finding out later it just went to the CEO of whatever to blow on blackjack and hookers.
In the case of Mozilla, you actually know donating to the Mozilla Foundation does not in any way benefit Firefox or Thunderbird, which is probably the whole reason you were actually donating in the first place. Donating to the Mozilla Foundation funds all the pointless side projects they they decide to pick up and pay the CEO quite frankly an undeservedly large salary.
Exactly what I've been saying when people complain about how public sector spends the taxes (especially when comparing against private sector so-called efficiency when managing hospitals or schools)
That probably means they receive a lot of small donations. Payment processors often have a fee structure that's 2.9% + <flat fee around $0.30>. So any donation below ~$4.50 would end up having a >=10% processing fee.
There could be currency exchange rates that are factored in at the donation end as well.
I agree that 10% is high, but it's still explainable.
Yeah, and those amounts are much more common when organizations are pushing for users to make their donation a monthly recurring donation resulting in much smaller transactions.
I believe they use stripe and this would also include:
$6.25 * 97% =$6.06 - $.30 =$5.76 That's $.49 in processing fees and .49/6.25=0.0784 So 8% rather than 10%.
I assume donations other than monthly are more like $15 or $25 but maybe there are people who do $5 or $3 or even $1.
Add in chargebacks, etc. and 10% unfortunately seems reasonable.
I do wish there was a way to pay companies that was less expensive for them but very little friction on my end. Venmo business is 1.9% + $.10 and that's better than I was expecting but still higher than ideal. I've encountered that once. Zelle depends on the business's bank and I've never encountered it as an alternative to credit cards.
Not affiliated with Mozilla or Venmo or Zelle in any way.
That is very high. Not sure who they are using for processing, but I know Stripe will give registered charities a (very small) cut on their fees, I'm not sure about non-profits. But even with market rates, the average fees through Stripe would be well below 10%, IME.
Although it could be higher if a lot of donations are small, and hitting the minimum transaction fees. The average could also be brought up if donations are made through the play or apple app stores, which have much higher takes.
I have the same beef with the Signal Foundation. A few years ago, I engaged with the new CEO when she was soliciting donations and asked whether they were going to publish any kind of high-level feature roadmap. I explained that there were a few features I was really looking forward to, and that I’d even written some code that might help expedite them getting rolled in. She told me that stuff like publishing roadmaps takes time and resources they don’t have.
I mean, as I've somewhat said above, I do donate to Mozilla for a direct-but-big reason. Overall, I find their work VERY important. I acknowledge that they've never been perfect, but I've watched what they've done for 20-30 years and strongly trust that generally, they're doing good things with my money because that's what they've been doing.
Thunderbird, separate from Mozilla, I don't think has that to rely on. That does feel more like "why should I give money to this project that (for me) has been pretty mid at maintaining a popular piece of software?"
I live in the EU and have read this in the terms for my region.
> they have no legal obligation to follow through and give you what they promised
Yes, they do. Contracts are contracts. They just don't promise you ownership of anything but a revocable license. Like every platform offering DRM protected content.
> I never understood why meta decided to join the race.
I can think of at least two reasons. Price and customizability. If they train their own models on their own data, they potentially have a better model at a better price, and they're not at the mercy of Anthropic's decisions when they decide to raise prices. Additionally, if you use someone else's model, you use it the way they create it and permit you to use it. In a couple years, who has any idea how these models are used. Arguably, a company the size of Meta should be in control of their AI models.
I think it's been clear from the beginning that the per-token price of usage was far below what it will be when firms have implemented their profit-maximizing price plans. "AI winter" will happen when these firms start maximizing profit. At that point it'll be too expensive for all but certain use cases to use the best technology for work.
We'll see AI chat replace Google, we'll see companies adopting AI in high-value areas, and we'll see local models like Gemma 4 get used heavily.
AI winter will see a disappearance of the clickbait headlines about everyone losing their jobs. Literally nobody is making those statements taking into account that pricing to this point is way less than the profit maximizing level.
I'm happy I invested in setting up Codex CLI and getting it to work with ollama. For the toughest jobs I can use Github Copilot (free as an academic) or Gemini CLI. If we see the per token price increase 5x or 10x as these companies move to focusing on revenue, local models will be the way to go, so long as stuff like Gemma 4 keeps getting released.
> We're fine, the trick is to remember to GET OFF THE INTERNET and remember that reality isn't the same as the Internet.
That works fine, except in the cases where the bad news reflects reality, or understates how bad the reality is. In that case it's like saying cancer isn't the problem, the problem is that you visited the doctor and listened as he told you bad news.
> That works fine, except in the cases where the bad news reflects reality
The issue is that the 24/7 Internet chatroom/forums shift the "bad news" target on a daily basis. Sometimes its war, others its natural disaster, others its a horrific crime, etc. If you've been only seeing bad news since Covid, then it makes you (read, made me) think the world's in a terrible place. I stopped spending allll my time in the 24/7 chatroom and when I say this IN the chatroom everyone thinks I'm completely unaware. I'm not. I just engage on other matters, like cheering on my buddies when they release something.
The world is (and the US is) a measurably more terrible place than only a few years ago, and a big part of the reason is that, whether or not they remain online, people are helplessly detached from events; being blissfully ignorant is not substantively different in societal impact than being in a state of paralysis from oversaturation of a mix of real, mis- and dis-informaton, even if it is more enjoyable in the near term.
Shutting off the feeds (especially those that are becoming more extremely manipulated to produce ineffective rage, which is part of how the world is worse) may be an effective way to manage the near-term stress of the present combination of media and material conditions, but it doesn't do anything to actually address the material conditions. Heck, detachment and demobilization to reduce resistance to arbitrary exercise of power is a big part of what you are being manipulated for. It's not an accident that that works as stress relief; that's part of the design of the manipulation.
> The world is (and the US is) a measurably more terrible place than only a few years ago
I neither agree nor disagree (if that makes sense), but I certainly agree that being modern Internet has warped people's views on things. I hear it called a "screen detox" via my Spotify BetterHelp ads and while I never used that service, I get what they mean.
Back during Digg 4.0 last year, one of the core members of users referred to it as "trying to have a conversation while attending a riot". Its a lot of third parties and faceless usernames chiming in, and if you don't answer all of them the impression can get equally get warped about the original intent of the conversation. Even how the conversation gets steered after the original comment is interesting to see.
I just think Covid made us all "get on the same wavelength", then someone(s) tainted that through things like heavy Reddit moderation. Like, we were all doing our own little things, then "everyone" is refreshing Johns Hopkins' dashboard, wondering if they have enough toilet paper because of the Seuz Canal, or watching all of the protest/riots unfold in other states.
But what got lost was no one going out to things, saving/gambling their money on the next short squeeze, and not supporting local stuff. If anything, GET OFF THE INTERNET is my attempt at manipulation/psyop/marketing campaign. And, locally, yeah, we're offline, openly talking about what we see on the different platforms since Reddit and Twitter are politically skewed, and sort of remembering a time before the pandemic.
I go to Magic the Gathering events at my LGS now. Its pretty cool to meet the nerds in that "missing third space". We're still talking about tariffs and global conflicts. We're just doing it respectfully and not trying to ruin the game at the same time cause not everyone agrees. I can even tell when someone is fresh off Arena because they play some of those insta-win meta combos. I just make tribal decks, I don't have time to study all that.
You can still read print media like WAPO, NYT, or WSJ. Stay away from opinion and editorial sections and you'll still be informed about what matters but not manipulated so much that it gives you anxiety.
Yeah, here's what Bezos wrote. I seriously doubt it ends with the opinion section:
> I’m writing to let you know about a change coming to our opinion pages...We are going to be writing every day in support of defense of two pillars: personal liberties and free markets. We’ll cover other topics too of course, but viewpoints opposing those pillars will be left to be published by others...
I'll leave it to others to make a decision on whether WAPO qualifies as a propaganda outfit.
While those listed papers may not be outright fabrications, they are very much manipulated by what their billionaire owners want you to know.
Part of the problem here is you can only list a few papers that might tell you the truth at all, when in the past there was far more independent news organizations that would vie against each other. Now they need to check in with their shareholders first.
late checking in on the conversation. I agree with you to a degree but it's better than the rage bait online. Also, with a physical piece of paper you can reach the end, it doesn't scroll forever. I was subscribed to the paper wsj for a while and that was my favorite part, i could reach the end.
Every WaPo reporter and editor doesn't check in with Bezos before a story goes to print. Yeah, the owners steer some stuff and kill some articles, but for the most part there's still very good reporting going on at the major US papers. It's a convenient fallacy to handwave away all established journalism because billionaire owners are chipping away around the edges.
>WaPo reporter and editor doesn't check in with Bezos before a story goes to print.
Reporters are at the bottom of the list, there is a pile of middle and upper management that does all this work for Bezos without his need to keep an eye on it.
All it takes is one phone call from him saying they need to be careful around a topic and that's it. Funds dry up for investigations into that topic.
Now, I never said 'throw away' journalism, I said to ensure you understand the bias of the paper in question. Just because WaPo isn't reporting on Bezos doesn't mean there isn't anything to report on said guy.
I just tried with llama.cpp RTX4090 (24GB) GGUF unsloth quant UD_Q4_K_XL
You can probably run them all. G4 31B runs at ~5tok/s , G4 26B A4B runs at ~150 tok/s.
You can run Q3.5-35B-A3B at ~100 tok/s.
I tried G4 26B A4B as a drop-in replacement of Q3.5-35B-A3B for some custom agents and G4 doesn't respect the prompt rules at all. (I added <|think|> in the system prompt as described (but have not spend time checking if the reasoning was effectively on). I'll need to investigate further but it doesn't seem promising.
I also tried G4 26B A4B with images in the webui, and it works quite well.
I have not yet tried the smaller models with audio.
> I'll need to investigate further but it doesn't seem promising.
That's what I meant by "waiting a few days for updates" in my other comment. Qwen 3.5 release, I remember a lot of complaints about: "tool calling isn't working properly" etc.
That was fixed shortly after: there was some template parsing work in llama.cpp. and unsloth pulled out some models and brought back better one for improving something else I can't quite remember, better done Quantization or something...
The model does call tools successfully giving sensible parameters but it seems to not picking the right ones in the right order.
I'll try in a few days. It's great to be able to test it already a few hours after the release. It's the bleeding edge as I had to pull the last from main. And with all the supply chain issues happening everywhere, bleeding edge is always more risky from a security point of view.
There is always also the possibility to fine-tune the model later to make sure it can complete the custom task correctly. But the code for doing some Lora for gemma4 is probably not yet available. The 50% extra speed seems really tempting.
Thank you. I have the same card, and I noticed the same ~100 TPS when I ran Q3.5-35B-A3B. G4 26B A4B running at 150TPS is a 50% performance gain. That's pretty huge.
It's interesting more people haven't talked about this. A lot of so-called agentic development is really just a very roundabout way to perform metaprogramming.
At my own firm, we generally have a rule we do almost everything through metaprogramming.
I strongly encourage you to provide that information on the page asking for donations. Even if it's just one sentence with a link and even if it doesn't fit with Mozilla's corporate policies.
reply