Page 1 of 1
erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Mon Nov 28, 2022 8:10 pm
by yuanzeluo
Hi,
I'm trying to detect sources in my combined image following the step-by-step example at the top of the eSASS cookbook. At the step erbackmap, I got the error
Code: Select all
erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
and the program was then killed without writing any outputs. I checked the documentation for erbox and looks like there is no column called "EXT" in the output source table...Any ideas on how to resolve this issue?
The command I used was
Code: Select all
erbackmap image="/home/idies/result_folder/events_image_0d2_8.fits" expimage="/home/idies/result_folder/expmap_0d2_8.fits" boxlist="/home/idies/result_folder/boxlist_local_0d2_8.fits" detmask="/home/idies/result_folder/detmask_0d2_8.fits" bkgimage="/home/idies/result_folder/bkg_map_0d2_8.fits" emin=200 emax=8000 cheesemask="/home/idies/result_folder/cheesemask_0d2_8.fits" fitmethod="smooth"
Thank you very much!
Re: erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Thu Dec 01, 2022 10:07 am
by AlainGueguen
Hi,
From the command you used, you are using eSASS in the Docker.
Could you tel us how you run the Docker ?
More specifically how much memory are you allocating to the Docker ?
The default settings would allocate 'only' 4Gb to the docker.
in this case could you try to increase the memory to 8 or 12 depending on the machine you are using ? (the instruction to specify the memory are in the docker documentation page on the edr wiki pages:
https://erosita.mpe.mpg.de/edr/DataAnal ... _container
Regards
Re: erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Thu Dec 01, 2022 10:13 am
by MiriamRamos
Hello Yuan,
You can find in the FAQ section (
https://erosita.mpe.mpg.de/edr/FAQ/) the ERROR2 topic. You are correct in your assessment that the EXT column does not exist, but this error does not affect the output of running erbackmap. And his error should not have killed the task, can you share more output?
Best wishes,
Miriam
Re: erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Thu Dec 01, 2022 2:58 pm
by yuanzeluo
Thank you for your replies!
I'm running docker from my own laptop and I simply started it from the terminal using
Code: Select all
docker run -v my/folder:/home/idies/result_folder -it --rm erosita/esass:latest /bin/bash
And the full output is
Code: Select all
erbackmap: eSASS4EDR Sep 02 09:43:31 2021
erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
File Parameter ENERG(100.-602.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(603.-1207.)EV
value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(SURVEY)
value overlaps CIF parameter OBSMODE("SURVEY")
File Parameter ENERG(1208.-2242.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(603.-1207.)EV
value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(1208.-2242.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
value DOES NOT overlap CIF ENERG(1100.00)
erbackmap/ero_cifsl: Accessing cal file tm1_2dpsf_190220v03.fits
Killed
So in this case the program getting killed could be due to the memory allocated to docker?
Re: erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Thu Dec 01, 2022 3:45 pm
by yuanzeluo
I checked my docker setting and I've been using 7.9 GB of memory for it. I tried to increase it to 12 GB but the same issue happened...all the files before the erbackmap step were generated following the cookbook example so I don't think there would be issues with them. Any other ideas?
Thank you for your patience!
Best regards,
Yuanze
Re: erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Fri Dec 09, 2022 3:04 pm
by yuanzeluo
I tried the same process on only one event file rather than the merged four, and it worked without this issue. So I guess the file size could be the problem. My final event file with image after merging the four event files is more than 1 GB. As I mentioned above I tried to increase the storage allocated to docker but the same issue remained...
I need the detected source catalog in my energy range because in the end I wish to use apetool to measure counts at locations of non-detection. If I run the source detection procedure on each of the four event files would it be the same as merging them first?
Thank you for your patience!
Best regards,
Yuanze
Re: erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Tue Dec 13, 2022 2:28 pm
by AlainGueguen
just an idea:
could you try to run your docker with an external folder for the /tmp directory also ?
by using an second "-v" option
for example with a command like :
Code: Select all
docker run -v $EROSITADATA/testdocker:/home/idies/result_folder -v /tmp:/tmp -it --rm erosita/esass:latest /bin/bash
regards
Alain
Re: erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found
Posted: Thu Dec 15, 2022 4:23 pm
by yuanzeluo
I tried
and
but they didn't work...did it work when you tested it? I'm using my mac and I'm not sure if this brings any other complications...