erbackmap/FGET_BOXLIST: **ERROR2** column EXT not found

[yuanzeluo]

Hi,

I'm trying to detect sources in my combined image following the step-by-step example at the top of the eSASS cookbook. At the step erbackmap, I got the error

Code: Select all

erbackmap/FGET_BOXLIST: **ERROR2** column EXT              not found

and the program was then killed without writing any outputs. I checked the documentation for erbox and looks like there is no column called "EXT" in the output source table...Any ideas on how to resolve this issue?

The command I used was

Code: Select all

erbackmap image="/home/idies/result_folder/events_image_0d2_8.fits" expimage="/home/idies/result_folder/expmap_0d2_8.fits" boxlist="/home/idies/result_folder/boxlist_local_0d2_8.fits" detmask="/home/idies/result_folder/detmask_0d2_8.fits" bkgimage="/home/idies/result_folder/bkg_map_0d2_8.fits" emin=200 emax=8000 cheesemask="/home/idies/result_folder/cheesemask_0d2_8.fits" fitmethod="smooth"

Thank you very much!

[AlainGueguen]

Hi,
From the command you used, you are using eSASS in the Docker.
Could you tel us how you run the Docker ?
More specifically how much memory are you allocating to the Docker ?
The default settings would allocate 'only' 4Gb to the docker.
in this case could you try to increase the memory to 8 or 12 depending on the machine you are using ? (the instruction to specify the memory are in the docker documentation page on the edr wiki pages: https://erosita.mpe.mpg.de/edr/DataAnal ... _container

Regards

[MiriamRamos]

Hello Yuan,

You can find in the FAQ section (https://erosita.mpe.mpg.de/edr/FAQ/) the ERROR2 topic. You are correct in your assessment that the EXT column does not exist, but this error does not affect the output of running erbackmap. And his error should not have killed the task, can you share more output?

Best wishes,
Miriam

[yuanzeluo]

Thank you for your replies!

I'm running docker from my own laptop and I simply started it from the terminal using

Code: Select all

docker run -v my/folder:/home/idies/result_folder -it --rm erosita/esass:latest /bin/bash

And the full output is

Code: Select all

erbackmap: eSASS4EDR Sep 02 09:43:31 2021
 erbackmap/FGET_BOXLIST: **ERROR2** column EXT              not found
File Parameter ENERG(100.-602.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(603.-1207.)EV
 value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(SURVEY)
 value overlaps CIF parameter OBSMODE("SURVEY")
File Parameter ENERG(1208.-2242.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(100.-602.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(603.-1207.)EV
 value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
 value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
 value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
 value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
 value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
 value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
 value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
 value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
 value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
 value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(603.-1207.)EV
 value overlaps CIF parameter ENERG(1100.00)
File Parameter OBSMODE(POINTING)
 value DOES NOT overlap CIF OBSMODE("SURVEY")
File Parameter ENERG(1208.-2242.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(1208.-2242.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(2243.-3753.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(3754.-5451.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(5452.-7217.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
File Parameter ENERG(7218.-12000.)EV
 value DOES NOT overlap CIF ENERG(1100.00)
 erbackmap/ero_cifsl: Accessing cal file tm1_2dpsf_190220v03.fits
Killed

So in this case the program getting killed could be due to the memory allocated to docker?

[yuanzeluo]

I checked my docker setting and I've been using 7.9 GB of memory for it. I tried to increase it to 12 GB but the same issue happened...all the files before the erbackmap step were generated following the cookbook example so I don't think there would be issues with them. Any other ideas?

Thank you for your patience!

Best regards,
Yuanze

[yuanzeluo]

I tried the same process on only one event file rather than the merged four, and it worked without this issue. So I guess the file size could be the problem. My final event file with image after merging the four event files is more than 1 GB. As I mentioned above I tried to increase the storage allocated to docker but the same issue remained...

I need the detected source catalog in my energy range because in the end I wish to use apetool to measure counts at locations of non-detection. If I run the source detection procedure on each of the four event files would it be the same as merging them first?

Thank you for your patience!

Best regards,
Yuanze

[AlainGueguen]

just an idea:
could you try to run your docker with an external folder for the /tmp directory also ?
by using an second "-v" option
for example with a command like :

Code: Select all

docker run -v $EROSITADATA/testdocker:/home/idies/result_folder -v /tmp:/tmp  -it --rm erosita/esass:latest /bin/bash

regards
Alain

[yuanzeluo]

I tried

Code: Select all

-v my_local_folder:/tmp

and

Code: Select all

-v my_local_folder:/var/tmp

but they didn't work...did it work when you tested it? I'm using my mac and I'm not sure if this brings any other complications...