1.0.2 -> 1.0.3-1: config files don't get regenerated

[lbm]

Hi all,
I got some problems after updating ICPCP from 1.0.2 to 1.0.3 on Debian Lenny.

Firstly
/etc/apache2/sites-available/ispcp.conf
did not get updated. The newly generated file has been pretty much empty after the "# Header End" line. In consequence every customer domain has been "routed" to the control panel. Well, no worries I used the backup and the server is running.

I got the same problem with binds named.conf. This one also did not show the domains after the "//bind Data BEGIN." line.
For bind I could again used the backup to keep the system running. Anyways, now the ispCP Debugger (in the WebFrontend) keeps telling me the following for every domain and every alias:

get_tag() | ERROR: '// bind Data BEGIN. ' ne '// bind Data END. ', '// bind Data END. ' overlaps '// bind Data BEGIN. ' in src !

I've seen ticket 159 ( http://isp-control.net/ispcp/ticket/159 ) and checked /etc/bind/* with the "file" command but it did not tell me anything about "CRLF line terminators" for any file.

The structure of named.conf looks like this

Code:

// "header stuff"
// bind Data BEGIN.

// dmn [xy] cfg entry BEGIN.
zone "xy" {
        type    master;
        file    "/var/cache/bind/xy.db";
        notify  YES;
};
// dmn [xy] cfg entry END.

// ...the dmn thing (harhar) for each domain...

// dmn [{DMN_NAME}] cfg entry BEGIN.
// dmn [{DMN_NAME}] cfg entry END.

// bind Data END.

Maybe someone got a clue? I'd appreciate any help to make the debugger friendly again .

For both files (apache2/ispcp.conf & named.conf) it would be nice to find a "ispCP-template-structure-plain-unmodified-file" (errr - you know what I mean?), such that I can check the structure of my files against them manually (just to be sure for the next update). But I don't know where to look for them

Thank you very much and cheers,
Thorsten

[kilburn]

Try to check the files in /etc/ispcp/bind/*. If you detect file with bad CRLF, correct it and regenerate configuration files (there's a howto in the docs).

[lbm]

(02-19-2010 01:12 PM)kilburn Wrote:  Try to check the files in /etc/ispcp/bind/*. If you detect file with bad CRLF, correct it and regenerate configuration files (there's a howto in the docs).

Thanks for your reply.
Unfortunately
find /etc/ispcp/bind -exec file "{}" ";" | grep CR
does not output any files with CRLF.

Should I still try to regenerate? Which files will be regenrated, by the way? Is it every config file? In that case I should backup /etc if this fails again... Is there some documentation on how this works internally? (this would stop me from asking these dumb questions )

And an UPDATE to my original Post:
Actually three files did not get regenerated during the update (the last one I spotted later, by watching the mail.logs)
/etc/apache2/sites-available/ispcp.conf
/etc/bind/named.conf
and now I found /etc/postfix/ispcp/domains was also empty. The other files in /etc/posftfix/ispcp were OK, though.

All this looks to me as if the config file generation did not iterate over the domains correctly (as I said, I'm not aware how this works internally ). If I got it right from kilburn's reply the files are generated using the templates and the stuff stored in the MySQL DB. Anyway, this would imply that the apache and postfix config files would be gone again after regenerating(?), wouldn't it?

Thanks a lot for any information!

[lbm]

OK, I did the regeneration:

1. find /etc/ispcp/bind/ -exec fromdos -v \{\} \; (to be sure to remove all potential CRLFs)
2. Did everything in: http://isp-control.net/documentation/dok...ate_config
3. logged into the CP. the debugger is still having the same problem.

get_tag() | ERROR: '// bind Data BEGIN. ' ne '// bind Data END. ', '// bind Data END. ' overlaps '// bind Data BEGIN. ' in src !

For each domain and domain alias.

Apache and mail configs are looking good, but ispCP still does not like the DNS config.

Another Update:
I removed /etc/bind/named.conf and did the regeneration but the file has not been created.

[lbm]

No ideas why the config file generation won't work? Maybe somebody got a clue where to investigate or how to get better debugging information?!?

[lbm]

I did some more investigation and it seems to be something wrong with my ISPCP installation.

After regenerating configs or adding a domain I get these errors:

Code:

# cat /var/log/ispcp/ispcp-dmn-mngr.stdout

DEBUG: push_el() sub_name: dmn_mngr_start_up(), msg: Starting...
DEBUG: push_el() sub_name: check_master(), msg: Starting...
DEBUG: push_el() sub_name: sys_command(), msg: Starting...
DEBUG: push_el() sub_name: sys_command('export COLUMNS=120;/bin/ps auxww | awk '$0 ~ /ispcp-rqst-mngr/ && $0 !~ /awk/ { print $2 ;}' 1>/tmp/ispcp-cc.stdout 2>/tmp/ispcp-cc.stderr'), msg: Ending...
DEBUG: push_el() sub_name: del_file(), msg: Starting...
DEBUG: push_el() sub_name: del_file(), msg: Ending...
DEBUG: push_el() sub_name: del_file(), msg: Starting...
DEBUG: push_el() sub_name: del_file(), msg: Ending...
DEBUG: push_el() sub_name: check_master(), msg: Ending...
DEBUG: push_el() sub_name: get_conf(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: setup_main_vars(), msg: Starting...
DEBUG: push_el() sub_name: decrypt_db_password(), msg: Starting...
DEBUG: push_el() sub_name: decrypt_db_password(), msg: Ending...
DEBUG: push_el() sub_name: setup_main_vars(), msg: Ending...
DEBUG: push_el() sub_name: get_conf(), msg: Ending...
DEBUG: push_el() sub_name: doSQL(), msg: Starting...
DEBUG: push_el() sub_name: doSQL(), msg: Ending...
DEBUG: push_el() sub_name: dmn_mngr_start_up(), msg: Ending...
DEBUG: push_el() sub_name: dmn_mngr_engine(), msg: Starting...
DEBUG: push_el() sub_name: doSQL(), msg: Starting...
DEBUG: push_el() sub_name: doSQL(), msg: Ending...
DEBUG: push_el() sub_name: dmn_mngr_engine(), msg: proceeding -> SELECT t1.domain_id, t1.domain_name, t1.domain_gid, t1.domain_uid, t1.domain_admin_id,
        t1.domain_created_id, t1.domain_created, t1.domain_last_modified, t1.domain_mailacc_limit, t1.domain_ftpacc_limit,
        t1.domain_traffic_limit, t1.domain_sqld_limit, t1.domain_sqlu_limit, t1.domain_status, t1.domain_alias_limit,
        t1.domain_subd_limit, t1.domain_ip_id, t1.domain_disk_limit, t1.domain_disk_usage, t1.domain_php,
        t1.domain_cgi, t2.ip_number FROM domain AS t1, server_ips AS t2 WHERE t1.domain_ip_id = t2.ip_id
        AND t1.domain_id = 33
DEBUG: push_el() sub_name: dmn_change_data(), msg: Starting...
DEBUG: push_el() sub_name: dmn_change_awstats_data(), msg: Starting...
DEBUG: push_el() sub_name: dmn_add_awstats_cfg_data(), msg: Starting...
DEBUG: push_el() sub_name: get_tpl(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: get_tpl(), msg: Ending...
DEBUG: push_el() sub_name: prep_tpl(), msg: Starting...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{AWSTATS_ENGINE_DIR}' eq '{AWSTATS_ENGINE_DIR}', missing '{AWSTATS_ENGINE_DIR}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{APACHE_LOG_DIR}' eq '{APACHE_LOG_DIR}', missing '{APACHE_LOG_DIR}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{AWSTATS_WEB_DIR}' eq '{AWSTATS_WEB_DIR}', missing '{AWSTATS_WEB_DIR}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{AWSTATS_CACHE_DIR}' eq '{AWSTATS_CACHE_DIR}', missing '{AWSTATS_CACHE_DIR}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{CMD_CAT}' eq '{CMD_CAT}', missing '{CMD_CAT}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{DOMAIN_NAME}' eq '{DOMAIN_NAME}', missing '{DOMAIN_NAME}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: prep_tpl(), msg: Ending...
DEBUG: push_el() sub_name: store_file(), msg: Starting...
DEBUG: push_el() sub_name: setfmode(), msg: Starting...
DEBUG: push_el() sub_name: setfmode(), msg: Ending...
DEBUG: push_el() sub_name: store_file(), msg: Ending...
DEBUG: push_el() sub_name: dmn_add_awstats_cfg_data(), msg: Ending...
DEBUG: push_el() sub_name: dmn_change_awstats_data(), msg: Ending...
DEBUG: push_el() sub_name: dmn_change_named_data(), msg: Starting...
DEBUG: push_el() sub_name: dmn_add_named_data(), msg: Starting...
DEBUG: push_el() sub_name: dmn_add_named_cfg_data(), msg: Starting...
DEBUG: push_el() sub_name: get_tpl(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: get_tpl(), msg: Ending...
DEBUG: push_el() sub_name: prep_tpl(), msg: Starting...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{DMN_NAME}' eq '{DMN_NAME}', missing '{DMN_NAME}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{DB_DIR}' eq '{DB_DIR}', missing '{DB_DIR}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{DMN_NAME}' eq '{DMN_NAME}', missing '{DMN_NAME}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{DB_DIR}' eq '{DB_DIR}', missing '{DB_DIR}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{DMN_NAME}' eq '{DMN_NAME}', missing '{DMN_NAME}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: repl_var(), msg: Starting...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Ending...
DEBUG: push_el() sub_name: repl_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '{DB_DIR}' eq '{DB_DIR}', missing '{DB_DIR}' in src !
DEBUG: push_el() sub_name: repl_var(), msg: Ending...
DEBUG: push_el() sub_name: prep_tpl(), msg: Ending...
DEBUG: push_el() sub_name: get_file(), msg: Starting...
DEBUG: push_el() sub_name: get_file(), msg: Ending...
DEBUG: push_el() sub_name: get_tag(), msg: Starting...
DEBUG: push_el() sub_name: get_tag(), msg: ERROR: '// bind Data BEGIN.
' ne '// bind Data END.
', '// bind Data END.
' overlaps '// bind Data BEGIN.
' in src !
DEBUG: pop_el() sub_name: get_tag(), msg: ERROR: '// bind Data BEGIN.
' ne '// bind Data END.
', '// bind Data END.
' overlaps '// bind Data BEGIN.
' in src !
DEBUG: push_el() sub_name: doSQL(), msg: Starting...
DEBUG: push_el() sub_name: doSQL(), msg: Ending...
DEBUG: push_el() sub_name: dmn_mngr_engine(), msg: Ending...

Can anybody help?