Github issue and reducing file duplication on disk
by Demolishun · in Torque 3D Beginner · 01/30/2013 (12:13 am) · 9 replies
Okay, I have figured out how to fork a repo and have the repo on the local machine. I also figured out how to update from the original repo by associating it with "upstream".
The problem is when I create a copy of the repo it duplicates a lot of files on the fork. For T3D 2.0 the original repo is nearly 800MB. While the fork is 650MB or around there. So why does it duplicate so much data locally? Is there a way to tell the fork that some of the file are somewhere else and only track differences?
The problem is when I create a copy of the repo it duplicates a lot of files on the fork. For T3D 2.0 the original repo is nearly 800MB. While the fork is 650MB or around there. So why does it duplicate so much data locally? Is there a way to tell the fork that some of the file are somewhere else and only track differences?
About the author
I love programming, I love programming things that go click, whirr, boom. For organized T3D Links visit: http://demolishun.com/?page_id=67
#2
01/30/2013 (9:42 am)
Daniel is correct. What you are seeing in your repo is what happens in SVN on the server. DVCS systems like git provide you with the complete history so that you are not reliant on the server for checking commit histories, blame, etc. But it comes with the local bloat that only the server sees with SVN.
#3
01/30/2013 (1:40 pm)
Ah, okay. Get bigger hard disk sounds like the answer. I am just glad I can tell the fork to get files from local disk on creation rather than re-downloading everything.
#4
i want to checkout only this folder:
https://github.com/ChrisCalef/Torque3D/tree/fbx/Engine/source
02/03/2013 (3:45 am)
is there anyway to checkout only a specific folder instead of a whole branch?i want to checkout only this folder:
https://github.com/ChrisCalef/Torque3D/tree/fbx/Engine/source
#5
Is anyone interested in seeing whether we can create a stripped-down T3D repository that contains just the engine source and doesn't include all the templates and so on? We'd probably have to include the libs, which is a significant amount of blob, but we could at least cut all the art and so on.
02/03/2013 (12:00 pm)
Nope, sorry.Is anyone interested in seeing whether we can create a stripped-down T3D repository that contains just the engine source and doesn't include all the templates and so on? We'd probably have to include the libs, which is a significant amount of blob, but we could at least cut all the art and so on.
#6
that is ridiculous.
" T3D repository that contains just the engine source and doesn't include all the templates and so on? "
+1.
but most of the time there need script side change also.so source and a template with script files only will be comfortable for programmers.no need of 2d art or 3d shape files.
is this possible:
any command to apply those changes to my repository(forked from t3d mit) .
than i will checkout my repository(https://github.com/muzaheed57/Torque3D)
after that i will rollback to previous status.
is that possible?
02/03/2013 (6:09 pm)
"Nope, sorry."that is ridiculous.
" T3D repository that contains just the engine source and doesn't include all the templates and so on? "
+1.
but most of the time there need script side change also.so source and a template with script files only will be comfortable for programmers.no need of 2d art or 3d shape files.
is this possible:
any command to apply those changes to my repository(forked from t3d mit) .
than i will checkout my repository(https://github.com/muzaheed57/Torque3D)
after that i will rollback to previous status.
is that possible?
#7
There is a plan to add a feature to the Project Manager that would allow us to remove the duplicate Templates for the PhysX examples. This will help reduce a good bit of the bloat.
02/04/2013 (10:25 am)
While I would like to see a more stripped down and lean repository we have to draw a line somewhere between convenience for coders and that of artists -- or anyone else who desires example art. I can't speak for anyone else in the Steering Committee but I've personally answered dozens of emails from Torque users wanting to know where and how to obtain Chinatown, Pacific, SectorT3D, etc... If we were to remove the current example art and offer it as a separate download for those who desire it I believe it would complicate installation instructions for far too many of our users who are not technical minded or computer savvy -- especially since art filepaths would have to match those set in script. There was also some worry that the community would feel that things were missing if we removed all of the art examples -- something that I personally would like to see replaced anyway. But now that the FPS Tutorial example project has been uploaded to it's own repository I could be willing to argue more for removal of similar art that is found within the Full Template -- which is the basis for my template restructuring workThere is a plan to add a feature to the Project Manager that would allow us to remove the duplicate Templates for the PhysX examples. This will help reduce a good bit of the bloat.
#8
02/04/2013 (11:25 am)
Hence, the build server. But I definitely understand your reasoning - I was just wondering whether the more veteran members of the community might appreciate a repo targeted at coders, not general users.
#9
Edit:
This could help create a market for 3rd party templates as well.
02/04/2013 (11:45 am)
Would it be plausible in the future to treat the Project Manager as a way to download templates from the web directly? So in the future users could get the project manager and grab the templates they want. This would make it so templates could be updated and fixed independent of the code base.Edit:
This could help create a market for 3rd party templates as well.
Torque Owner Daniel Buckmaster
T3D Steering Committee
So, to answer your question, not really as far as I can tell. :(