Better TGB Bug Tracker
by Clint Herron · in Torque Game Builder · 09/10/2007 (3:28 pm) · 6 replies
First off, I'm a huge fan of TGB, and I try to actively support it -- it's really the best thing out there right now.
Still, I feel it could be better, and I guess that's what this forum folder is for.
1. Bug reports going unnoticed.
Maybe it's just me, but I feel like many bug submissions go unheeded and unnoticed by anyone with the power to do anything about them. It's been really frustrating to me to spend most of an evening chasing down a bug, then another hour typing up a bug report and creating a sample project, only to have it die and go completely unnoticed.
I've spent hours tracking down and writing a couple of detailed bug reports, but I've never seen any of this work make its way to any real GG employee. I've only done 2 or 3 of these (1, 2), but without any fruit from these, is there any reason for me to write up more?
2. Duplicate threads.
It seems like every third thread is a dupe of a previously reported bug -- often with a community-made patch/workaround, except that it's buried among a half a dozen threads that are all talking about the same core issue. I dealt with this recently trying to find a fix to the file saving issues in TGB 1.5.x, and it was a real pain to have to open up 3 different forum sections, clicking on titles that I thought vaguely might deal with my issue, trying to track down which one might have a fix for me. I found the fix one day, but forgot to save the link, so I had to repeat the process four days later when I actually had time to implement it. This is time I'd rather spend coding my game than navigating a disorganized forum with un-merged duplicate threads.
I'm reminded of the Firefox Most Frequently Reported Bugs list.
3. Unclear bug status / plan.
There are a number of issues that have been bugging us for a long time with TGB. Collision warping is one, as well as doubled memory usage. I could list more, but that's not the point I'm trying to make. As a developer, I have a hard time knowing when issues are resolved, if it's worthwhile for me to upgrade, etc. I can pour over changelogs at the release date, but without solid bug tracker numbers to go off of, I have a very hard time telling if my particular issues have been resolved or not, to weigh the cost of upgrade.
So these are just some of the issues that I feel could be resolved by making a publicly available bug tracker.
To help issue #1, it would help bug reports from the end users (us), get directly assigned to GG employees who could fix them. It would eliminate the middle man of having a GG employee keep track of the forums, wade through the reports, pick out the ones he feels are valid, and copy/paste them with modifications into the bug tracker system.
To help issue #2, it would allow reports to be marked as duplicates / dependents on each other, and eliminate much of the clutter that is currently found when wading through the sprawled TGB forums.
To help issue #3, it would allow a centralized place for feedback, test cases, status reports, "later/wontfix" notices, workarounds, sample projects, and capture logs. It would let me clearly see what issues are carried over to later releases, and which ones have been fixed so that I can justify the upgrade cost.
Perhaps GG already has an internal Bugzilla database. I know that maintaining a publicly accessible CVS server was more trouble than it was worth. Here's hoping that GG hasn't become too jaded from that experience to consider opening up their bug tracker publicly?
I realize that there are certainly a number of issues with this, such as hiding future feature plans from the consumer base and whatnot -- my idea isn't a complete solution. Today is just one of those days that I would love to have access to a TGB bug tracker.
Thanks! :)
--clint
Still, I feel it could be better, and I guess that's what this forum folder is for.
1. Bug reports going unnoticed.
Maybe it's just me, but I feel like many bug submissions go unheeded and unnoticed by anyone with the power to do anything about them. It's been really frustrating to me to spend most of an evening chasing down a bug, then another hour typing up a bug report and creating a sample project, only to have it die and go completely unnoticed.
I've spent hours tracking down and writing a couple of detailed bug reports, but I've never seen any of this work make its way to any real GG employee. I've only done 2 or 3 of these (1, 2), but without any fruit from these, is there any reason for me to write up more?
2. Duplicate threads.
It seems like every third thread is a dupe of a previously reported bug -- often with a community-made patch/workaround, except that it's buried among a half a dozen threads that are all talking about the same core issue. I dealt with this recently trying to find a fix to the file saving issues in TGB 1.5.x, and it was a real pain to have to open up 3 different forum sections, clicking on titles that I thought vaguely might deal with my issue, trying to track down which one might have a fix for me. I found the fix one day, but forgot to save the link, so I had to repeat the process four days later when I actually had time to implement it. This is time I'd rather spend coding my game than navigating a disorganized forum with un-merged duplicate threads.
I'm reminded of the Firefox Most Frequently Reported Bugs list.
3. Unclear bug status / plan.
There are a number of issues that have been bugging us for a long time with TGB. Collision warping is one, as well as doubled memory usage. I could list more, but that's not the point I'm trying to make. As a developer, I have a hard time knowing when issues are resolved, if it's worthwhile for me to upgrade, etc. I can pour over changelogs at the release date, but without solid bug tracker numbers to go off of, I have a very hard time telling if my particular issues have been resolved or not, to weigh the cost of upgrade.
So these are just some of the issues that I feel could be resolved by making a publicly available bug tracker.
To help issue #1, it would help bug reports from the end users (us), get directly assigned to GG employees who could fix them. It would eliminate the middle man of having a GG employee keep track of the forums, wade through the reports, pick out the ones he feels are valid, and copy/paste them with modifications into the bug tracker system.
To help issue #2, it would allow reports to be marked as duplicates / dependents on each other, and eliminate much of the clutter that is currently found when wading through the sprawled TGB forums.
To help issue #3, it would allow a centralized place for feedback, test cases, status reports, "later/wontfix" notices, workarounds, sample projects, and capture logs. It would let me clearly see what issues are carried over to later releases, and which ones have been fixed so that I can justify the upgrade cost.
Perhaps GG already has an internal Bugzilla database. I know that maintaining a publicly accessible CVS server was more trouble than it was worth. Here's hoping that GG hasn't become too jaded from that experience to consider opening up their bug tracker publicly?
I realize that there are certainly a number of issues with this, such as hiding future feature plans from the consumer base and whatnot -- my idea isn't a complete solution. Today is just one of those days that I would love to have access to a TGB bug tracker.
Thanks! :)
--clint
About the author
#2
I can really understand the disadvantages. If people misuse the blog system to ask poorly-worded questions about making custom Marble Blast levels, how much worse would it be for them to abuse the bug tracker to ask for help? It might help damage control to limit public accessibility to just the forums, and keep the internal Mantis database clean and "public free" just so they can't muck with it. Mozilla has to spend a fair bit of time just managing new submissions to the bug database -- I guess I can really understand if GG isn't interested in providing yet another avenue of clutter.
So yeah. I'd still like to have access to a bug tracker, but I can really see the issues that would be raised with that, and it's not a slam-dunk case.
Thanks for hearing out my rant! It was even longer before, and took me a while to trim off 700 characters of my original post so that it would accept it. :)
--clint
09/11/2007 (10:20 am)
Thanks for the reply, Matt. :)I can really understand the disadvantages. If people misuse the blog system to ask poorly-worded questions about making custom Marble Blast levels, how much worse would it be for them to abuse the bug tracker to ask for help? It might help damage control to limit public accessibility to just the forums, and keep the internal Mantis database clean and "public free" just so they can't muck with it. Mozilla has to spend a fair bit of time just managing new submissions to the bug database -- I guess I can really understand if GG isn't interested in providing yet another avenue of clutter.
So yeah. I'd still like to have access to a bug tracker, but I can really see the issues that would be raised with that, and it's not a slam-dunk case.
Thanks for hearing out my rant! It was even longer before, and took me a while to trim off 700 characters of my original post so that it would accept it. :)
--clint
#3
12/22/2007 (5:39 pm)
I'd like it if we had a real bug database as opposed to only having the bug reports forum.. There are plenty of little bugs (for example calls to nonexistant functions, random console warnings/errors/spam) that I almost feel bad posting in the bugs forum next to the real, show stopping bugs.
#4
12/23/2007 (9:44 am)
Mantis is up and running, but I do not know who all has access to the various sections. They are looking at a more robust system for the transparent development web suite for Torque 2. While it may not be possible, it is my hopes that pieces (such as bug tracking) will be spread to other products, too.
#5
12/24/2007 (3:42 am)
I would love love love to have Mantis available for TGB. And I would marry it if people attached Diffs when fixes are made. Then I could patch and commit to my local SVN repo.
#6
I kind of had to assume that it was noticed and listed for a 'fix' somewhere. When 1.6 came out, the bug was still there. Frustrating, and though I check for 1.6.1 every day, I have no illusion that it may be magically fixed.
Perhaps a halfway solution would be to make the bug forum more formal. Every legitimate bug reported there should be responded to by a GG employee, saying something, whether "Unable to duplicate" or "fixed for next release" or something. Any acknowledgment that the bug was noted by someone who works for GG would better than the black hole that it is now.
Greg
01/02/2008 (5:50 pm)
As an example of what Clint was talking about, I submitted a bug note in the forum when 1.5 then 1.5.1 came out regarding the Mac custom cursor bug. (The hardware cursor is always displayed on top of the custom cursor. New bug in 1.5, worked fine in 1.1.3)I kind of had to assume that it was noticed and listed for a 'fix' somewhere. When 1.6 came out, the bug was still there. Frustrating, and though I check for 1.6.1 every day, I have no illusion that it may be magically fixed.
Perhaps a halfway solution would be to make the bug forum more formal. Every legitimate bug reported there should be responded to by a GG employee, saying something, whether "Unable to duplicate" or "fixed for next release" or something. Any acknowledgment that the bug was noted by someone who works for GG would better than the black hole that it is now.
Greg
Torque 3D Owner Matthew Langley
Torque
We do currently use Mantis internally (with some external users at times) and we have a process of posting, assigning, and fixing involving our QA department.
We are a bit worried about opening our existing bug database to the public, though we may consider some options.