hey, been getting this error when trying to upload stuff, seems like there's a server error but only for uploading stuff, i can download just fine.
anyone else having the same issue?
Failed to upload "/Members/porres/software/else/1.0-0_beta36_with_live_electronics_tutorial/elsev1.0-0_beta36_with_live_electronics_tutorial.dek".
Operation : PUT /Members/porres/software/else/1.0-0_beta36_with_live_electronics_tutorial/elsev1.0-0_beta36_with_live_electronics_tutorial.dek
Expected code : 200 OK, 201 Created, 204 No Content
Actual code : 500 Internal Server Error
Couldn't upload to https://puredata.info/Members/porres/software/else/1.0-0_beta36_with_live_el... !
Are you sure you have the correct username and password set for ' https://puredata.info%27?
Please ensure the folder '/Members/porres/software/else/1.0-0_beta36_with_live_electronics_tutorial' exists on the server and is writable.
I had to reupload all binaries and remake the release cause I found a bug.
So, before, I had an issue only with one of the windows binaries. I also found issues with other binaries, but it was intermittent, it didn't work once or twice, but then it then it worked.
Now that I re uploaded, I was able to upload all binaries but both of the windows ones... (one of which was uploaded before just fine). I can't seem to get these ones up... so, well, I don't know, this seems weird.
cheers
Em qua., 16 de dez. de 2020 às 09:35, Alexandre Torres Porres < porres@gmail.com> escreveu:
hey, been getting this error when trying to upload stuff, seems like there's a server error but only for uploading stuff, i can download just fine.
anyone else having the same issue?
Failed to upload "/Members/porres/software/else/1.0-0_beta36_with_live_electronics_tutorial/elsev1.0-0_beta36_with_live_electronics_tutorial.dek".
Operation : PUT /Members/porres/software/else/1.0-0_beta36_with_live_electronics_tutorial/elsev1.0-0_beta36_with_live_electronics_tutorial.dek
Expected code : 200 OK, 201 Created, 204 No Content
Actual code : 500 Internal Server Error
Couldn't upload to https://puredata.info/Members/porres/software/else/1.0-0_beta36_with_live_el... !
Are you sure you have the correct username and password set for ' https://puredata.info%27?
Please ensure the folder '/Members/porres/software/else/1.0-0_beta36_with_live_electronics_tutorial' exists on the server and is writable.
On 12/16/20 1:35 PM, Alexandre Torres Porres wrote:
hey, been getting this error when trying to upload stuff, seems like there's a server error but only for uploading stuff, i can download just fine.
that's because the server ran out of disk space. the server is a virtual machine, so i doesn't really have ressources as your desktop.
the issue is mainly caused by two deken projects consuming excessive amounts of disk space: "else" and "ossia"
## ossia the ossia package itself is small (~3MB per package), but the accompanying sources are huge (>100MB zipped). this is because the source-package contains >300MB of 3rd party libraries required for building. @antoine would it be possible to omit the 3rd party libraries from the Sources-package and replace them with a README that says how to obtain them (or a script that fetches them)?
## else the problem here is that there is a lot of platform independent data (e.g. a 5+MB-file of of white noise; wtf?), duplicated across all package versions and all platforms. a typical package of else is about 30MB (zipped). this does not seem too much, but given that there are 10 different architectures supported by else (and each is shipped in a separate package) and your upload rate is >3 per month (for each package!), the numbers just sum up.
i accept that this is to a certain extend a problem with the deken infrastructure (namely: not being able to specify dependencies).
it's also due to my insisting that you do not remove releases from puredata.info.
but i think we need to do something about it.
@porres for the time being i would like to ask you to:
- remove the live-electronics-tutorial from the "else" distribution
until you do a proper release.
- merge multiple architectures into a single package (e.g. you could
have a package containing Darwin-amd64-32, Darwin-i386-32,
Linux-amd64-32, Linux-i386-32, Linux-arm64-32 and Linux-armv8-32; and
probably Windows-i386-32 and Windows-amd64-32 too, but i didn't test as
the current uploads are broken)
this requires some changes in your build pipeline, as you would need to
use arch-specific suffixes (e.g. l_i386 for Linux-i386-32) rather than
the generic OS-specific ones (pd_linux for all the Linux archs).
as there we currently don't have different suffixes for the various
32bit arm variants, you would still need to package these separately)
as an immediate remedy, i would even like to ask you to remove old alpha-releases (and it breaks my heart to say that).
fgsatmt IOhannes
On Thu, 2020-12-17 at 10:03 +0100, IOhannes m zmoelnig wrote:
- remove the live-electronics-tutorial from the "else" distribution
until you do a proper release.
How about not packaging it at all? Personally, I'd rather have only externals in my externals directory, considering that people (me included) install this stuff on many kinds of devices, sometimes with space constraints. For myself, I need only one copy on my laptop and not on every Raspberry Pi. Maybe you could host it separately and link to it from ELSE's documentation? Since Pd 0.50 with [pdcontrol], you can even have clickable weblinks in patches without using additional externals.
This is not meant as rant, rather as a honest suggestions for improving the user experience of your library. I know how dedicated you are and how much work you put into this.
Roman
Em qui., 17 de dez. de 2020 às 06:07, IOhannes m zmoelnig zmoelnig@iem.at escreveu:
## else the problem here is that there is a lot of platform independent data (e.g. a 5+MB-file of of white noise; wtf?), duplicated across all package versions and all platforms.
What do you mean about that? what's the white noise?
a typical package of else is about 30MB (zipped). this does not seem too much, but given that there are 10 different architectures supported by else (and each is shipped in a separate package) and your upload rate is >3 per month (for each package!), the numbers just sum up.
yeah, it's a lot, but it's 9 architectures and for the year I've released (so far) 9 of them (27=>35), and I was trying to have 7 versions uploaded when we hit the issue. So, well, 30 x 7 x 9 => about 1.9BG, yikes! The release rate got pretty high in the last 2 months cause I was teaching a course and really dove into this.
i accept that this is to a certain extend a problem with the deken infrastructure (namely: not being able to specify dependencies).
it's also due to my insisting that you do not remove releases from puredata.info.
but i think we need to do something about it.
@porres for the time being i would like to ask you to:
- remove the live-electronics-tutorial from the "else" distribution
until you do a proper release.
- merge multiple architectures into a single package (e.g. you could
have a package containing Darwin-amd64-32, Darwin-i386-32, Linux-amd64-32, Linux-i386-32, Linux-arm64-32 and Linux-armv8-32; and probably Windows-i386-32 and Windows-amd64-32 too, but i didn't test as the current uploads are broken) this requires some changes in your build pipeline, as you would need to use arch-specific suffixes (e.g.
l_i386for Linux-i386-32) rather than the generic OS-specific ones (pd_linuxfor all the Linux archs). as there we currently don't have different suffixes for the various 32bit arm variants, you would still need to package these separately)as an immediate remedy, i would even like to ask you to remove old alpha-releases (and it breaks my heart to say that).
Ok, I'll see how to build and upload this in a better way, joining up at all raspberries versions (maybe removing one or another, cause I have FOUR right now and maybe that's just silly and not needed), both linuxes and both windowses...
I had the compromise to keep around 5 of the last versions around. So I removed the one I was trying to upload and will hold it and try to do this in the new way. I removed one of the lasts and I'm keeping 5 old versions so far.
cheers
Em qui., 17 de dez. de 2020 às 14:24, Alexandre Torres Porres < porres@gmail.com> escreveu:
Em qui., 17 de dez. de 2020 às 06:07, IOhannes m zmoelnig zmoelnig@iem.at escreveu:
## else the problem here is that there is a lot of platform independent data (e.g. a 5+MB-file of of white noise; wtf?), duplicated across all package versions and all platforms.
What do you mean about that? what's the white noise?
ok, got rid of 2 files that shouldn't be there actually, saved 7MB
@porres for the time being i would like to ask you to:
- remove the live-electronics-tutorial from the "else" distribution
until you do a proper release.
- merge multiple architectures into a single package (e.g. you could
have a package containing Darwin-amd64-32, Darwin-i386-32, Linux-amd64-32, Linux-i386-32, Linux-arm64-32 and Linux-armv8-32; and probably Windows-i386-32 and Windows-amd64-32 too, but i didn't test as the current uploads are broken)
I need help here, I don't know how to do that! I only have a single binary for macOS (fat), so it's fine. The linuxes binaries I'm generating are all .pd_linux so I don't know how to merge them and same goes for windows (which are both .dll). So, please, give me some hints.
Ok, I'll see how to build and upload this in a better way, joining up at all raspberries versions (maybe removing one or another, cause I have FOUR right now and maybe that's just silly and not needed),
For my last release, we uploaded "only" three... Esteban told me one of them was somewhat rare, but maybe we can narrow it down to two and put them together.
Cheers
-
Alexandre Torres Porres -
IOhannes m zmoelnig -
Roman Haefeli