section:algosec:documentation:usefullcommands
Differences
This shows you the differences between two versions of the page.
| Both sides previous revisionPrevious revisionNext revision | Previous revision | ||
| section:algosec:documentation:usefullcommands [2021/11/15 15:17] – patrik | section:algosec:documentation:usefullcommands [2023/09/29 07:01] (current) – external edit 127.0.0.1 | ||
|---|---|---|---|
| Line 3: | Line 3: | ||
| ====== Useful Algosec commands, troubleshooting and information ====== | ====== Useful Algosec commands, troubleshooting and information ====== | ||
| + | // | ||
| + | by Patrik Hermansson | ||
| + | // | ||
| ===== Usefull commands, summary ===== | ===== Usefull commands, summary ===== | ||
| * [[usefullcommands# | * [[usefullcommands# | ||
| Line 28: | Line 31: | ||
| ===== Troubleshooting, | ===== Troubleshooting, | ||
| - | * Backup in gui won’t work (backup is already running error whith manual backup) | + | * [[usefullcommands# |
| - | * To view speed and duplex on an interface | + | * [[usefullcommands# |
| - | * Sync the database with the reports directory (problem with searching in objects) | + | * [[usefullcommands# |
| - | * To clear type history in BASH | + | * [[usefullcommands# |
| - | * To enable debug-mode in FireFlow (CLI) | + | * [[usefullcommands# |
| - | * Verify that the garbage cleanup script have been running | + | * [[usefullcommands# |
| - | * AFA traffic simulation in CLI | + | * [[usefullcommands# |
| - | * Kill (shut down) stuck or big application queries (CLI) | + | * [[usefullcommands# |
| - | * Low free disk space on / or /data partitions | + | * [[usefullcommands# |
| - | * A short SQL-query to get all interfaces with associated IP from all the firewalls in the map | + | * [[usefullcommands# |
| - | * Licens will not install in CLI | + | * [[usefullcommands# |
| - | * ABF application flows will not save | + | * [[usefullcommands# |
| - | * Local account admin could not login | + | * [[usefullcommands# |
| - | * Cansle connectivity check in ABF | + | * [[usefullcommands# |
| - | * Art / elasticsearch / kibana backup problems | + | * [[usefullcommands# |
| - | * Fetchmail troubleshooting, | + | * [[usefullcommands# |
| - | * Menubar not showing in AppViz after upgrade to A30.10 | + | * [[usefullcommands# |
| - | * Verify disk speed is up to standard | + | * [[usefullcommands# |
| - | * Username no longer case sensative? | + | * [[usefullcommands# |
| + | * [[usefullcommands# | ||
| + | * [[usefullcommands# | ||
| ===== Other useful information, | ===== Other useful information, | ||
| - | * Needed ports for cluster and functions | + | * [[usefullcommands# |
| - | * Where the risk profiles are located | + | * [[usefullcommands# |
| - | * Regex for search in Notepad++ | + | * [[usefullcommands# |
| - | * How to use screens in Linux | + | * [[usefullcommands# |
| - | * How to identify users in the system | + | * [[usefullcommands# |
| - | * BZIP2 and GZIP archiving | + | * [[usefullcommands# |
| - | * TAR commands | + | * [[usefullcommands# |
| - | * How to Encrypt and Decrypt Files and Directories Using Tar and OpenSSL | + | * [[usefullcommands# |
| - | * How to activate debug mode in ABF | + | * [[usefullcommands# |
| - | * Boostmode on and off | + | * [[usefullcommands# |
| - | * To get destination NAT from firewalls in ASMS databas | + | * [[usefullcommands# |
| - | * Cluster node suddanly removed from cluster | + | * [[usefullcommands# |
| - | * How the user field in ABF flows work | + | * [[usefullcommands# |
| - | * How to get a session id | + | * [[usefullcommands# |
| - | * How to look into .tar, .zip, .bz2 files without unpacking them | + | * [[usefullcommands# |
| - | * How to clean up the session database table in postgres | + | * [[usefullcommands# |
| - | * Guide for LVM on new setup virtual appliance | + | |
| Line 274: | Line 278: | ||
| ### Exit the postgres configuration mode | ### Exit the postgres configuration mode | ||
| \q | \q | ||
| + | |||
| + | |||
| + | ---- | ||
| + | ====== Troubleshooting ====== | ||
| + | === Backup in gui won’t work (backup is already running error whith manual backup) === | ||
| + | Try to restart Apache | ||
| + | / | ||
| + | or | ||
| + | service restart apache-tomcat | ||
| + | or | ||
| + | systemctl restart apache-tomcat | ||
| + | The differenses are regarding of version of ASMS. | ||
| + | |||
| + | === To view speed and duplex on an interface === | ||
| + | Use the command ethtool, to see speed and duplex on the interface eth0 use the following command | ||
| + | ethtool eth0 | ||
| + | Output(example): | ||
| + | Settings for eth0: | ||
| + | Supported ports: [ TP ] | ||
| + | Supported link modes: | ||
| + | 100baseT/ | ||
| + | 1000baseT/ | ||
| + | Supported pause frame use: No | ||
| + | Supports auto-negotiation: | ||
| + | Advertised link modes: | ||
| + | 100baseT/ | ||
| + | 1000baseT/ | ||
| + | Advertised pause frame use: Symmetric | ||
| + | Advertised auto-negotiation: | ||
| + | Link partner advertised link modes: | ||
| + | | ||
| + | Link partner advertised pause frame use: No | ||
| + | Link partner advertised auto-negotiation: | ||
| + | Speed: 1000Mb/s | ||
| + | Duplex: Full | ||
| + | Port: Twisted Pair | ||
| + | PHYAD: 1 | ||
| + | Transceiver: | ||
| + | Auto-negotiation: | ||
| + | MDI-X: on | ||
| + | Supports Wake-on: g | ||
| + | Wake-on: g | ||
| + | Current message level: 0x000000ff (255) | ||
| + | drv probe link timer ifdown ifup rx_err tx_err | ||
| + | Link detected: yes | ||
| + | |||
| + | === Sync the database with the reports directory (problem with searching in objects) === | ||
| + | Login as afa user or switch to the afa user. (su afa) run the script below. Then logout and login again. | ||
| + | / | ||
| + | |||
| + | === To clear type history in BASH === | ||
| + | In Bash (the terminal) the commands are saved in the .bash_history file. If you write usernames and passwords in the terminal those are saved as commands in that file. In clear text! | ||
| + | Password without echo (when you do not see the text) are not saved. Only the character that you see. | ||
| + | To clear the file from entries, do the following. (needs to be done in all open windows (cli logins) if more than one SSH session is active/ | ||
| + | history -c | ||
| + | history -w | ||
| + | |||
| + | The flag -c == clear the history list by deleting all entries. | ||
| + | The flag -w == writes over the .bash_history file with the empty list thereby clearing it. | ||
| + | |||
| + | The commands you write in the active (open) window will be saved in memory and written in the file on exit/ | ||
| + | |||
| + | === To enable debug-mode in FireFlow (CLI) === | ||
| + | Log in to AFA as root user using SSH. \\ | ||
| + | Run the following command (as a single line, linebrake after FireFlow_SiteConfig.pm, | ||
| + | cp -p / | ||
| + | |||
| + | Add the following lines at the end of the FireFlow_SiteConfig.pm file before the line ending with 1; | ||
| + | |||
| + | vim / | ||
| + | |||
| + | Set($LogToFile, | ||
| + | Set($LogMaxMsgLen, | ||
| + | Set($LogPermissions, | ||
| + | |||
| + | Restart FireFlow: | ||
| + | restart_fireflow | ||
| + | |||
| + | Recreate the problematic scenario that you want to troubleshoot. \\ | ||
| + | Download the fireflow.zip file and attach it to the support case. \\ | ||
| + | In the FireFlow_SiteConfig.pm file, remove or comment with # the lines you added above to enable debugging. \\ | ||
| + | |||
| + | Restart FireFlow: | ||
| + | restart_fireflow | ||
| + | |||
| + | === Verify that the garbage cleanup script have been running === | ||
| + | This is to cleanup / | ||
| + | |||
| + | df -ih | ||
| + | |||
| + | Run this to see if the garbage cleanup script have been running: | ||
| + | grep " | ||
| + | |||
| + | Example output: | ||
| + | [root@ASMS_2017-2 ~]# grep " | ||
| + | / | ||
| + | |||
| + | === AFA traffic simulation in CLI === | ||
| + | The AFA traffic simulation feature has a CLI version.The bennefit of this compared to the GUI version is that You get much more troubleshooting info, when You have patch discovery (MAP) problems. | ||
| + | |||
| + | Log in as AFA user if not that already | ||
| + | su afa | ||
| + | |||
| + | Run the command test_fip with the following commands | ||
| + | test_fip -s [from-ip] -d [destination-ip] –o | ||
| + | flag -s: source | ||
| + | flag -d: destination | ||
| + | flag -o: prints fip output if given | ||
| + | |||
| + | Example: | ||
| + | test_fip -s 172.18.113.5 -d 172.19.150.97 –o | ||
| + | |||
| + | === Kill (shut down) stuck or big application queries (CLI) === | ||
| + | For instance when the application is stuck in initial plan. \\ | ||
| + | In the CLI enter the commands: \\ | ||
| + | ps -ef | grep 18619 | ||
| + | ps -ef | grep run_query | ||
| + | | ||
| + | Where 18619 is the ticket ID. \\ | ||
| + | |||
| + | Then kill those PIDs | ||
| + | Kill -9 [pid] | ||
| + | |||
| + | === Low free disk space on / or /data partitions === | ||
| + | If disk utilization is high on the root ( / ) partition the system might stop working. \\ | ||
| + | Also some functions like backup and report gathering might stop working if the /data partition is full. To fix (at least some of the problems) look at the KB article below. | ||
| + | |||
| + | Login is needed: | ||
| + | [[https:// | ||
| + | |||
| + | === Check the status for vacuum db function (Star/stop) === | ||
| + | The following is the command to check the vacuum | ||
| + | |||
| + | grep -i vacuum / | ||
| + | i.e | ||
| + | grep -i vacuum / | ||
| + | |||
| + | === Metro service do not start " | ||
| + | The SSL configuration is not removed from one or all nodes. \\ | ||
| + | Configure the machine_config file (/ | ||
| + | |||
| + | vim / | ||
| + | | ||
| + | Change secure_conection=true => secure_conection=false | ||
| + | |||
| + | Restart apache-tomcat service | ||
| + | |||
| + | service apache-tomcat restart | ||
| + | |||
| + | === A short SQL-query to get all interfaces with associated IP from all the firewalls in the map === | ||
| + | In CLI on the AlgoSec server run: | ||
| + | |||
| + | sqlite3 / | ||
| + | |||
| + | Edit: this command will also show subnet-ID with CIDR-mask. | ||
| + | |||
| + | sqlite3 / | ||
| + | |||
| + | === Licens will not install in CLI === | ||
| + | For version 2018.1.x-x \\ | ||
| + | If this occures on the second device in a DA/HA cluster check if the metro service is running. \\ | ||
| + | Usually not, and to start you need to start the apache-tomcat service.\\ | ||
| + | |||
| + | service start apache-tomcat or systemctl start apache-tomcat.service | ||
| + | |||
| + | Rememeber to shut it down after the installation of the license. | ||
| + | service stop apache-tomcat or systemctl stop apache-tomcat.service | ||
| + | |||
| + | === ABF application flows will not save === | ||
| + | This could be because of not allowed text (text that can be translated into code) in some of the comments fields. | ||
| + | Affected fields: | ||
| + | Custom fields | ||
| + | Flow Names | ||
| + | Comments | ||
| + | |||
| + | Algosec KB for this: [[https:// | ||
| + | |||
| + | Example on what is considered as code: | ||
| + | < | ||
| + | </ | ||
| + | src=" | ||
| + | eval(*) | ||
| + | expression(*) | ||
| + | javascript: | ||
| + | vbscript: | ||
| + | onload*= | ||
| + | | ||
| + | also avoid write <*> html tags | ||
| + | |||
| + | " | ||
| + | |||
| + | === Local account admin could not login === | ||
| + | Check the followin KB: | ||
| + | [[https:// | ||
| + | |||
| + | If that looks ok, check if two or more accounts have the same password. Is possible if new user are added via the users_info.xml file. \\ | ||
| + | If that is the case remove the other account or change the email to specific emails for all accounts. \\ | ||
| + | |||
| + | === Cansle connectivity check in ABF === | ||
| + | There MAY be a workaround. It isn't verified, but we have used it in other occasions when an ABF application seems to be stuck in updating: \\ | ||
| + | \\ | ||
| + | First, Connect to postgres | ||
| + | |||
| + | root@ITSEELM-BB4261: | ||
| + | Password for user postgres: | ||
| + | psql (9.2.5) | ||
| + | Type " | ||
| + | |||
| + | Enable prettyprint & connect to the bflow database | ||
| + | postgres=# \x on | ||
| + | |||
| + | Expanded display is on. | ||
| + | postgres=# \c bflow | ||
| + | |||
| + | You are now connected to database " | ||
| + | |||
| + | Select the application with the ID. This can be found in the URL. Example: | ||
| + | " | ||
| + | |||
| + | bflow=# select * from applications where id=2797; | ||
| + | | ||
| + | -[ RECORD 1 ]------------------+--------------------------- | ||
| + | id | 2797 | ||
| + | app_id | 2433 | ||
| + | creation_ts | 2019-04-01 11: | ||
| + | lcname | mfc-le-sto-371 | ||
| + | name | MFC-LE-STO-371 | ||
| + | update_ts | 2019-04-01 11: | ||
| + | connectivity_id | 85479 | ||
| + | metadata_id | 1100 | ||
| + | revision_id | 2827 | ||
| + | connectivity_scan_in_progress | f | ||
| + | vulnerability_scan_in_progress | f | ||
| + | last_risk_check | | ||
| + | risk_scan_in_progress | f | ||
| + | risk_score | | ||
| + | risks_information_up_to_date | f | ||
| + | discovery_update_in_progress | f | ||
| + | |||
| + | This gives us some data to look at. What we need for next step is the APP_ID field. Use this field in the next query: | ||
| + | bflow=# select * from application_metadata where appId=2433; | ||
| + | -[ RECORD 1 ]------+--------------------------- | ||
| + | id | 1100 | ||
| + | appid | 2433 | ||
| + | applicationlock | t | ||
| + | creation_ts | 2019-02-20 12: | ||
| + | update_ts | 2019-02-20 12: | ||
| + | lifecyclephase_id | 1 | ||
| + | name_sequence | 1 | ||
| + | expiration_date | | ||
| + | rename_in_progress | f | ||
| + | |||
| + | This shows us that the applicationlock field is indeed TRUE. set this to FALSE using the APPLICATION_METADATA ID, not the application ID: | ||
| + | bflow=# update application_metadata set applicationlock=false where id=1100; | ||
| + | UPDATE 1 | ||
| + | |||
| + | Verify that the flag is correct (False): | ||
| + | bflow=# select * from application_metadata where appId=2433; | ||
| + | -[ RECORD 1 ]------+--------------------------- | ||
| + | id | 1100 | ||
| + | appid | 2433 | ||
| + | applicationlock | f | ||
| + | creation_ts | 2019-02-20 12: | ||
| + | update_ts | 2019-02-20 12: | ||
| + | lifecyclephase_id | 1 | ||
| + | name_sequence | 1 | ||
| + | expiration_date | | ||
| + | rename_in_progress | f | ||
| + | |||
| + | Quit when done. | ||
| + | bflow=# \q | ||
| + | |||
| + | === Art / elasticsearch / kibana backup problems === | ||
| + | The new backup needs the elasticsearch service to be running. It will fail othervice. (Version 2018.2 => ) \\ | ||
| + | In at least 2018.2.870 - 2018.2.900 there wherer a mismach with the versions of elasticsearch and kiban4. This could generate problems with the services and backups. \\ | ||
| + | The problem is resolved in version 2018.2.900-xyz (accoring to Algosec)\\ | ||
| + | |||
| + | Elasticsearch: | ||
| + | Check the service via: | ||
| + | service elasticsearch status | ||
| + | or | ||
| + | systemctl status elasticsearch | ||
| + | |||
| + | Check that the service starts with the system | ||
| + | chkconfig | grep -i elasticsearch | ||
| + | |||
| + | Kibana: \\ | ||
| + | Check the service via: | ||
| + | service kibana4 status | ||
| + | or | ||
| + | systemctl status kibana4 | ||
| + | |||
| + | Check that the service starts with the system | ||
| + | chkconfig | grep -i kibana4 | ||
| + | |||
| + | There is a script to start the services (or stop them) and enable the start with the system. \\ | ||
| + | Script: toggle_art.sh \\ | ||
| + | To run it: | ||
| + | / | ||
| + | use the on/off to turn it on or of... | ||
| + | / | ||
| + | or | ||
| + | / | ||
| + | |||
| + | === Fetchmail troubleshooting, | ||
| + | Log: / | ||
| + | Symptom: The system does not get (fetches) emails from email server. \\ | ||
| + | Test the function with the following command: | ||
| + | / | ||
| + | Exchange POP3 and 995 --ssl if needed. Enter username and server FQDN or ip. | ||
| + | \\ | ||
| + | If that works follow the checklist below. If not check the logfile to see what went wrong. | ||
| + | Check: \\ | ||
| + | That the ownership are correct on the file, .fetchmailrc. (fireflow should be owner of the file) as user root do: | ||
| + | |||
| + | chown fireflow: | ||
| + | | ||
| + | That the rights are correct on the file, .fetchmailrc (chmod 0700) \\ | ||
| + | as user root do: | ||
| + | chmod 0700 .fetchmailrc | ||
| + | |||
| + | Login at fireflowuser (su - fireflow), test with | ||
| + | / | ||
| + | without any more inforamtion. The command get the rest from the .fetchmailrc file in / | ||
| + | \\ | ||
| + | If it gives an error make sure that point 1 and 2 are done and that the .fetchmailrc file is correctly filled in. In one instance the file needed to be redone to get it working. | ||
| + | |||
| + | === Menubar not showing in AppViz after upgrade to A30.10 === | ||
| + | Problem: \\ | ||
| + | After upgradeing to version A30.10 the AppViz (fd Businessflow) menu (blue top row) does not show. \\ | ||
| + | \\ | ||
| + | Troubleshooting: | ||
| + | When checking in the webbrowser the URL gave wrong rederict URL. For us the domain was missing. | ||
| + | \\ | ||
| + | Solution: \\ | ||
| + | Check in the AppViz config file. (/ | ||
| + | The following parameters needs to be populated with the full url: \\ | ||
| + | afa.hostname=****************** (removed for the document) | ||
| + | fireflow.hostname=****************** (removed for the document) | ||
| + | |||
| + | === Verify disk speed is up to standard === | ||
| + | The disk speed (read/ | ||
| + | Below is built in check for upgradeing the system. \\ | ||
| + | \\ | ||
| + | Is blocked | ||
| + | | ||
| + | 0------80------ 80---------100-----------------------------300--------------- ==> \\ | ||
| + | \\ | ||
| + | So to have a good system at least there should be R/W of 300MB/s \\ | ||
| + | \\ | ||
| + | How to check this? \\ | ||
| + | Linux tools hdparm (for read) and dd (for write). \\ | ||
| + | \\ | ||
| + | Disclamer!\\ | ||
| + | Not sure how much this will affect the system so do this outsid of working hours for production. \\ | ||
| + | !Disclamer \\ | ||
| + | |||
| + | hdparm -Ttv [partition, like /dev/sdb1] | ||
| + | |||
| + | dd if=/ | ||
| + | |||
| + | if = input file, of = output file. Put it someherer the system can write ~4GB (in this setting). Remember to remove the of file. \\ | ||
| + | \\ | ||
| + | On my home system with older SATA disk i got: \\ | ||
| + | |||
| + | root@system# | ||
| + | 32768+0 records in | ||
| + | 32768+0 records out | ||
| + | 4294967296 bytes (4.3 GB, 4.0 GiB) copied, 53.6856 s, 80.0 MB/s | ||
| + | |||
| + | So 80.0 MB/s in write speed. | ||
| + | |||
| + | === Username no longer case sensative? === | ||
| + | System Version: A32.0.x-y \\ | ||
| + | \\ | ||
| + | One incident when user could not login, had a duplicate user when one was all lower case and one user with first letter upper case. The system tried to match with the first username in the list and that was the one with upper case. Not the actual account and the user could not login. \\ | ||
| + | \\ | ||
| + | Solution?: \\ | ||
| + | Ended up deleting the account with upper case first letter and user could login again after that. | ||
| + | |||
| + | === Needed ports for cluster and functions === | ||
| + | If possible for uptime allow any ports between the nodes in HA. \\ | ||
| + | Twice i have had problem at customer due to the fact Algosec did not update there documentation for needed ports. \\ | ||
| + | Not in documentation nor in KB. (Custemer have PVLAN with ACL) \\ | ||
| + | |||
| + | ^Type ^Port ^CM ↔ Slave ^CM ↔ RA ^Slave ↔ Slave ^HA/ | ||
| + | |icmp | V | V | - | V | V | V | | ||
| + | |ssh |tcp/22 | V | V | - | V | V | V | | ||
| + | |https | tcp/ | ||
| + | |syslog |udp/ | ||
| + | |hazelcast |tcp/ | ||
| + | |activemq |tcp/61616 | V | - | - | V | - | - | | ||
| + | |postgresql |tcp/ | ||
| + | |pgpool | ||
| + | |HA/DR |tcp/ | ||
| + | |heartbeat |udp/ | ||
| + | (not in use since 2018.1) | ||
| + | \\ | ||
| + | \\ | ||
| + | \\ | ||
| + | Ports required for communications (central manager, remote agents) in geo-distributed architecture.\\ | ||
| + | 1. For configuration procedures (adding a remote agent, adding/ | ||
| + | ^Port ^Protocol ^Description ^Purpose ^ | ||
| + | |22 |TCP |SSH |Required for running commands upon the remote agent from the central manager | | ||
| + | |||
| + | 2. For log collection, monitor and data collections procedures that may be asynchronous: | ||
| + | ^Port ^Protocol ^Description ^Purpose ^ | ||
| + | |443 |TCP |SOAP over HTTPS |Required for running commands and obtaining the status of the remote agent and current actions performed on it| | ||
| + | |22 |TCP |SCP |Required for copying files to and from the remote agent| | ||
| + | |||
| + | 3. For communications between master-slave in load-distributed architecture: | ||
| + | ^Port ^Protocol ^Description ^Purpose ^ | ||
| + | |443 |TCP |SOAP over HTTPS |From master to slave| | ||
| + | |22 |TCP | ||
| + | |5432 |TCP | ||
| + | |5433 |TCP | ||
| + | |||
| + | === Where the risk profiles are located === | ||
| + | / | ||
| + | Files are saved as *.xml | ||
| + | |||
| + | === Regex for search in Notepad++ === | ||
| + | To search after ip-addresses in Notepad++ use the following regex: | ||
| + | [0-9]+.[0-9]+.[0-9]+.[0-9]+ | ||
| + | or | ||
| + | \b(25[0-5]|2[0-4]\d|1\d\d|[1-9]? | ||
| + | |||
| + | === How to use screens in Linux === | ||
| + | Screen(s) is a good way to make sure that updates or other things will keep on going and that infromation in the shell will be avialiable even if the connection is severed between the client and the server. \\ | ||
| + | You can reconnect to the session and the information is still there. \\ | ||
| + | \\ | ||
| + | For the Algosec session i will use the session-name of algosec \\ | ||
| + | \\ | ||
| + | #Start a screen session | ||
| + | screen | ||
| + | OR | ||
| + | screen -S [name of session] | ||
| + | |||
| + | #List active screens on the system | ||
| + | screen -ls | ||
| + | OR | ||
| + | screen -list | ||
| + | |||
| + | --- *** output *** --- | ||
| + | #named session algosec | ||
| + | [root@server ~]# screen -ls | ||
| + | There is a screen on: | ||
| + | 27466.algosec | ||
| + | 1 Socket in / | ||
| + | |||
| + | #Connect to an detached screen on the system | ||
| + | screen -r [screenname/ | ||
| + | |||
| + | screen -r algosec | ||
| + | |||
| + | === BZIP2 and GZIP archiving === | ||
| + | This can be done with singel file(s) \\ | ||
| + | |||
| + | * GZIP * \\ | ||
| + | Compress a single file \\ | ||
| + | gzip [filename] ## This will create a compressed file and remove the original file. | ||
| + | |||
| + | Compress multiple files at once \\ | ||
| + | gzip [filename1] [filename2] [filename3] | ||
| + | |||
| + | Compress a single file and keep the original \\ | ||
| + | gzip -c [filename] > [filename].gz | ||
| + | |||
| + | Decompress a gzip compressed file \\ | ||
| + | gzip -d [filename] | ||
| + | or | ||
| + | gunzip [filename] | ||
| + | |||
| + | Decompress a gzip file but keep the original compressed file \\ | ||
| + | gunzip -c [filename].gz > [filename] | ||
| + | |||
| + | * BZIP2 * \\ | ||
| + | Create archive \\ | ||
| + | bzip2 [filename] ## This will create a compressed file and remove the original file. | ||
| + | |||
| + | If not to delete the original file use -k \\ | ||
| + | bzip2 -k [filename] ## The original file is NOT deleted | ||
| + | |||
| + | Decompress archives \\ | ||
| + | bzip2 -d [filename] | ||
| + | |||
| + | === TAR commands === | ||
| + | To build tar archives \\ | ||
| + | tar -vcf [filename] | ||
| + | |||
| + | To build tar archives with gzip encryption \\ | ||
| + | This can be done with folder(s) \\ | ||
| + | tar -zvcf [filename.tar.gz] [file/ | ||
| + | |||
| + | To build tar archives with bzip2 encryption \\ | ||
| + | This can be done with folder(s) \\ | ||
| + | bzip2 have a harder compression, | ||
| + | tar -jvcf [filename.bz2] [file/ | ||
| + | |||
| + | To Decompress tar archive \\ | ||
| + | tar -xvf [filename] | ||
| + | |||
| + | To Decompress tar archive with gzip \\ | ||
| + | tar -zxvf [filename].tar.gz | ||
| + | |||
| + | To Decompress tar archive with bzip2 \\ | ||
| + | tar -jxvf [filename].bz2 | ||
| + | |||
| + | === How to Encrypt and Decrypt Files and Directories Using Tar and OpenSSL === | ||
| + | Remember that the conventional form of using OpenSSL is: \\ | ||
| + | openssl command command-options arguments \\ | ||
| + | To encrypt the contents of the current working directory \\ | ||
| + | |||
| + | tar -czf - * | openssl enc -e -aes256 -out secured.tar.gz | ||
| + | |||
| + | Explanation of the above command: | ||
| + | enc – openssl command to encode with ciphers | ||
| + | -e – a enc command option to encrypt the input file, which in this case is the output of the tar command | ||
| + | | ||
| + | -out – enc option used to specify the name of the out filename, secured.tar.gz | ||
| + | \\ | ||
| + | \\ | ||
| + | Decrypt Files in Linux \\ | ||
| + | To decrypt a tar archive contents, use the following command. \\ | ||
| + | |||
| + | openssl enc -d -aes256 -in secured.tar.gz | tar xz -C test | ||
| + | |||
| + | Explanation of the above command: | ||
| + | -d – used to decrypt the files | ||
| + | -C – extract in subdirectory named test | ||
| + | |||
| + | === How to activate debug mode in ABF === | ||
| + | You need to enable debug mode to troubleshoot BusinessFlow. \\ | ||
| + | Solution\\ | ||
| + | To enable debug mode in BusinessFlow: | ||
| + | 1. Log in to AFA as root user using SSH. | ||
| + | 2. Edit the following file / | ||
| + | a. Change the following line: | ||
| + | < | ||
| + | to | ||
| + | < | ||
| + | (( 3. Restart the apache-tomcat service. )) ###usually not needed | ||
| + | |||
| + | === Boostmode on and off === | ||
| + | Script download: https:// | ||
| + | \\ | ||
| + | \\ | ||
| + | To install boostmode, perform the following, unzip the script and move it to the system under /tmp/ (this can be applied on GEO’s, Slaves, HA secondaries, | ||
| + | \\ | ||
| + | As root: | ||
| + | cp / | ||
| + | chmod 755 / | ||
| + | chkconfig boostmode on | ||
| + | service boostmode start # this may take a few minutes | ||
| + | |||
| + | After the service has started, you must restart all the relevant services: | ||
| + | service activemq restart | ||
| + | service apache-tomcat restart | ||
| + | service algosec-ms restart | ||
| + | service postgresql reload | ||
| + | restart_fireflow | ||
| + | |||
| + | It’s important to communicate to the customer that they will also need to perform the following steps after applying any hotfixes or patches in the future – as these can overwrite some of the boostmode settings. \\ | ||
| + | After successfully installing hotfixes the following should be run as root:\\ | ||
| + | |||
| + | service boostmode start | ||
| + | service activemq restart | ||
| + | service apache-tomcat restart | ||
| + | service algosec-ms restart | ||
| + | |||
| + | service postgresql reload | ||
| + | restart_fireflow | ||
| + | |||
| + | Boost mode can be disabled just by running: | ||
| + | service boostmode stop | ||
| + | |||
| + | Stopping the service will roll back all the changes. \\ | ||
| + | |||
| + | Before | ||
| + | ------- | ||
| + | [root@algosec-RA ~]# swapon -s | ||
| + | Filename | ||
| + | / | ||
| + | [root@algosec-RA ~]# | ||
| + | |||
| + | After | ||
| + | ------ | ||
| + | [root@algosec ~]# swapon -s | ||
| + | Filename | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | / | ||
| + | [root@algosec ~]# | ||
| + | |||
| + | === Cluster node suddanly removed from cluster === | ||
| + | Problem: \\ | ||
| + | On node in the cluster removed from the cluster. \\ | ||
| + | \\ | ||
| + | Logs: \\ | ||
| + | HA logs (/ | ||
| + | Messages log (/ | ||
| + | \\ | ||
| + | Low disk space: \\ | ||
| + | On one node, in ha logs (collect from ha menue (algosec_conf 13)). Or in HA logs, there will be a entry of low disk space and that cluster will be broken due to that. Log of this is on the node that was removed from the cluster. \\ | ||
| + | To low disk space is less that 10% free space (on any partition? Maby but surely on the /data partition)\\ | ||
| + | |||
| + | === How the user field in ABF flows work === | ||
| + | The field is populated from either the ABF database OR the supported firewall. (like Palo Alto/ | ||
| + | You cannot combine the two source of users, like rest of the produkt. Only one or the other is used at one or the other time. \\ | ||
| + | Also the users possibly to populate the user field needs to be present in the firewall. More test on this should be done to verify. \\ | ||
| + | Settings to change this is found uder:\\ | ||
| + | ABF => [name in upper right corner] => Administration => Configuration => User Awareness Support => USer validation via LDAP is Currently [on/off] \\ | ||
| + | \\ | ||
| + | If on = get from firewall \\ | ||
| + | If off = get from ABF user database \\ | ||
| + | |||
| + | === How to get a session id === | ||
| + | GUI: | ||
| + | 1. Go to the AFA home page (the portion displaying graphs). | ||
| + | 2. In the Web browser box, type ?" | ||
| + | 3. Click Enter. | ||
| + | A popup displays a unique session ID. | ||
| + | |||
| + | CLI: | ||
| + | 1. Go to the CLI and type the following command:ls -ltr / | ||
| + | A list of session IDs displays. | ||
| + | 2. Make a note of the latest session ID. | ||
| + | |||
| + | === How to look into .tar, .zip, .bz2 files without unpacking them === | ||
| + | .tar | ||
| + | |||
| + | .zip | ||
| + | zcat [cat] | ||
| + | zmore [more] | ||
| + | zless [less] | ||
| + | |||
| + | Or if the .zip contains multiple files | ||
| + | vim [file].zip | ||
| + | |||
| + | Example | ||
| + | zcat testfile.zip | ||
| + | vim testfile.zip | ||
| + | |||
| + | *** .bz2 | ||
| + | bzcat [cat] | ||
| + | bzless [less] | ||
| + | vim | ||
| + | |||
| + | === How to clean up the session database table in postgres === | ||
| + | In some versions of ASMS the session table just grows and grows. This is a bug! \\ | ||
| + | To manually empty the database session table do the procedure below. \\ | ||
| + | |||
| + | ######################### | ||
| + | # Important before synk # | ||
| + | ######################### | ||
| + | |||
| + | ++++++++++++++++++++++++++++++++++++++++ | ||
| + | + Check the postgres /session db table + | ||
| + | ++++++++++++++++++++++++++++++++++++++++ | ||
| + | |||
| + | This is the procedure \\ | ||
| + | \\ | ||
| + | On the active node (where all services are runnig AFA,AFF,DB) \\ | ||
| + | Stop services as follows: \\ | ||
| + | |||
| + | / | ||
| + | service crond stop | ||
| + | service apache-tomcat stop | ||
| + | service algosec-ms stop | ||
| + | service postgresql stop | ||
| + | service activemq stop | ||
| + | service httpd stop | ||
| + | service logstash stop | ||
| + | service elasticsearch stop | ||
| + | service kibana stop | ||
| + | service mongod stop | ||
| + | service aff-boot stop | ||
| + | |||
| + | Once all services are stopped bring the postgresql service back up with ' | ||
| + | Once postgres run the following commands from the CLI. \\ | ||
| + | |||
| + | psql -U postgres -d rt3 -c ' | ||
| + | psql -U postgres -d rt3 -c ' | ||
| + | |||
| + | Once the commands finish bring the rest of the services back online. \\ | ||
| + | |||
| + | service crond start | ||
| + | service httpd start | ||
| + | service postgresql start | ||
| + | service activemq start | ||
| + | service apache-tomcat start | ||
| + | service algosec-ms start | ||
| + | service aff-boot start | ||
| + | / | ||
| + | service logstash start | ||
| + | service elasticsearch start | ||
| + | service kibana start | ||
| + | service mongod start | ||
| + | |||
| + | === Guide for LVM on new setup virtual appliance === | ||
| + | ################ | ||
| + | # Up to A30.20 # | ||
| + | ################ | ||
| + | |||
| + | Fix the LVM on the devices \\ | ||
| + | Lists all disks in the system (as fdisk -l) \\ | ||
| + | lsblk | ||
| + | |||
| + | parted /dev/sdb | ||
| + | moves from msdos to guided partition table for disks over 2TB | ||
| + | |||
| + | mktable GPT | ||
| + | |||
| + | Creates a partition of 50GB | ||
| + | mkpart 0 1 50000 | ||
| + | |||
| + | Create a partition of the rest of the disk | ||
| + | mkpart 0 50001 100% | ||
| + | |||
| + | Lists all disks in the system (as fdisk -l) | ||
| + | lsblk | ||
| + | |||
| + | Creates the physical volumes of the new partitions | ||
| + | pvcreate /dev/sdb1 | ||
| + | pvcreate /dev/sdb2 | ||
| + | |||
| + | Extend the volume group / | ||
| + | vgextend / | ||
| + | vgextend / | ||
| + | |||
| + | Extend the logial volumes with the new partitions (-r will extend automaticly) | ||
| + | lvextend -r / | ||
| + | lvextend -r / | ||
| + | |||
| + | if not -r extends the logical volumes automaticly do the following | ||
| + | for ext4 filesystem | ||
| + | resize2fs / | ||
| + | resize2fs / | ||
| + | |||
| + | for xfs filesystem | ||
| + | xfs_growfs / | ||
| + | xfs_growfs / | ||
| + | |||
| + | To check the filesystem expends ok via watch per second | ||
| + | screen | ||
| + | watch -n 1 -d "df -hT" | ||
| + | ip addr | ||
| + | watch -n 1 -d "df -hT" | ||
| + | |||
| + | ################### | ||
| + | # For ASMS V32 => # | ||
| + | ################### | ||
| + | Differences is that volume group and logical volumes have new names / different locations. \\ | ||
| + | \\ | ||
| + | Fix the LVM on the devices\\ | ||
| + | Lists all disks in the system (as fdisk -l)\\ | ||
| + | lsblk | ||
| + | |||
| + | |||
| + | parted /dev/sdb | ||
| + | | ||
| + | moves from msdos to guided partition table for disks over 2TB | ||
| + | mktable GPT | ||
| + | |||
| + | Creates a partition of 50GB | ||
| + | mkpart 0 1 50000 | ||
| + | |||
| + | Create a partition of the rest of the disk | ||
| + | mkpart 0 50001 100% | ||
| + | |||
| + | Lists all disks in the system (as fdisk -l) | ||
| + | lsblk | ||
| + | |||
| + | Creates the physical volumes of the new partitions | ||
| + | pvcreate /dev/sdb1 | ||
| + | pvcreate /dev/sdb2 | ||
| + | |||
| + | Extend the volume group / | ||
| + | vgextend /dev/centos /dev/sdb1 | ||
| + | vgextend /dev/centos /dev/sdb2 | ||
| + | |||
| + | Extend the logial volumes with the new partitions (-r will extend automaticly) | ||
| + | lvextend -r / | ||
| + | lvextend -r / | ||
| + | |||
| + | if not -r extends the logical volumes automaticly do the following | ||
| + | for ext4 filesystem | ||
| + | resize2fs / | ||
| + | resize2fs / | ||
| + | |||
| + | for xfs filesystem | ||
| + | xfs_growfs / | ||
| + | xfs_growfs / | ||
| + | |||
| + | To check the filesystem expends ok via watch per second | ||
| + | screen | ||
| + | watch -n 1 -d "df -hT" | ||
| + | ip addr | ||
| + | watch -n 1 -d "df -hT" | ||
| + | |||
section/algosec/documentation/usefullcommands.1636989462.txt.gz · Last modified: 2023/09/29 07:01 (external edit)