Read a file and extract specific lines using Native Ansible Modules

-

I never realised that reading a file on a remote host and extracting specific lines from that file would be such an arduous task. As part of one of my projects, I had this requirement and without using "cat" or other shell utilities, it was quite cumbersome to read and extract the information that I was looking for. Read on to find out how it can be done using Ansible native commands.


Note that I have suggested only one out of a possible many methods. Feel free to explore yourself and update the comments here!

REMOTE FILE CONTENTS 
$ cat /tmp/IP_and_hostnames.txt
$ cat /tmp/IP_and_hostnames.txt
192.168.230.165:example-host-1.example.com
192.168.230.166:example-host-2.example.com
192.168.230.167:example-host-3.example.com
192.168.230.175:example-host-1-vip.example.com
192.168.230.176:example-host-2-vip.example.com
192.168.230.177:example-host-3-vip.example.com
192.168.230.185:example-host-1-priv.example.com
192.168.230.186:example-host-2-priv.example.com
192.168.230.187:example-host-3-priv.example.com
192.168.230.195:oracle-rac-scan.example.com
192.168.230.196:oracle-rac-scan.example.com
192.168.230.197:oracle-rac-scan.example.com


REQUIREMENT

 

From the above file, fetch only the hostnames (with and without domain name and only hostnames that don’t contain the “-vip”, “-scan” and “-priv” strings) and the corresponding IP Addresses

  1. extract only the hostnames without “-vip”, “-scan” and “-priv” strings and without IP Address (see below) 
example-host-1.example.com
example-host-2.example.com
example-host-3.example.com

 

  1. extract only the hostnames without domain and without “-vip”, “-scan” and “-priv” strings and without IP Address (see below) 
example-host-1
example-host-2
example-host-3
  1. extract only the IP Addresses corresponding to the hostnames and without “-vip”, “-scan” and “-priv” strings (see below) 
192.168.230.165
192.168.230.166
192.168.230.167

 

SOLUTION IN SHELL 
## Get the list of hosts (with and without the domain name) 
## and the list of IP addresses and write to the temp hosts list file.
IP_AND_HOSTNAMES_FILE=/tmp/IP_and_hostnames.txt
DOMAIN_NAME=example.com
TEMP_HOST_LIST_FILE=/tmp/specific_IP_and_hostnames.txt
awk -F':' '! /scan/ && ! /priv/ && ! /vip/ {print $2}' ${IP_AND_HOSTNAMES_FILE} | sed -e "s,\.${DOMAIN_NAME},,g" >> ${TEMP_HOST_LIST_FILE} ## Hostnames without domain
awk -F':' '! /scan/ && ! /priv/ && ! /vip/ {print $2}' ${IP_AND_HOSTNAMES_FILE} >> ${TEMP_HOST_LIST_FILE} ## Hostnames with domain
awk -F':' '! /scan/ && ! /priv/ && ! /vip/ {print $1}' ${IP_AND_HOSTNAMES_FILE} >> ${TEMP_HOST_LIST_FILE} ## IP Addresses of hostnames

 

SOLUTION IN ANSIBLE 
---
  - hosts: all
    gather_facts: False
    vars:
      IP_AND_HOSTNAMES_FILE: /tmp/IP_and_hostnames.txt
      DOMAIN_NAME: example.com
      HOST_DETAILS_FILE: /tmp/specific_IP_and_hostnames.txt

    tasks:
      - name: Read the IP_AND_HOSTNAMES_FILE using slurp module
        ansible.builtin.slurp:
              src: "{{ IP_AND_HOSTNAMES_FILE }}"
        register: ip_and_hostnames_file_contents_in_base_64

      - name: Print the output of the file - IP_AND_HOSTNAMES_FILE that was read using slurp - into register variable ip_and_hostnames_file_contents_in_plain_text
        debug:
          msg: "{{ ip_and_hostnames_file_contents_in_base_64['content'] | b64decode }}"
        register: ip_and_hostnames_file_contents_in_plain_text

      - name: Write the hosts with the domain name using the variable - ip_and_hostnames_file_contents_in_plain_text - to a file
        lineinfile:
              path: "{{ HOST_DETAILS_FILE }}"
              line: "{{ item.split(':')[1] }}"
              create: True
        with_items: "{{ ip_and_hostnames_file_contents_in_plain_text.msg.split('\n') }}"
        when:
          - "'scan' not in item"
          - "'priv' not in item"
          - "'vip' not in item"
          - "item != ''"

      - name: Write the hosts without the domain name using the variable - ip_and_hostnames_file_contents_in_plain_text - to a file
        lineinfile:
              path: "{{ HOST_DETAILS_FILE }}"
              line: "{{ item.split(':')[1].split('.')[0] }}"
              create: True
        with_items: "{{ ip_and_hostnames_file_contents_in_plain_text.msg.split('\n') }}"
        when:
          - "'scan' not in item"
          - "'priv' not in item"
          - "'vip' not in item"
          - "item != ''"

      - name: Write the IP Address of the RAC hosts using the variable - ip_and_hostnames_file_contents_in_plain_text - to a file
        lineinfile:
              path: "{{ HOST_DETAILS_FILE }}"
              line: "{{ item.split(':')[0] }}"
              create: True
        with_items: "{{ ip_and_hostnames_file_contents_in_plain_text.msg.split('\n') }}"
        when:
          - "'scan' not in item"
          - "'priv' not in item"
          - "'vip' not in item"
          - "item != ''"

 

Comments

Post a Comment

Popular posts from this blog

java.lang.ExceptionInInitializerError while trying to Access login page

-
Today morning, we (the DBAs) were faced with a strange issue. On Saturday (the 14th of February - (St.) Valentine's day!!), the UNIX boxes hosting our critical test instance went down for scheduled maintenance without any prior information. So, we could not bring down our databases and applications. As soon as the unix box came up, we encountered this issue. Let me briefly describe the environment, the issue, the analysis performed and of course, the solution to this most vexing problem. Environment : Apps Version : 11.5.10.2 with ATG RUP 5 DB Version : 10.2.0.3 Architecture : Two Node instance with database + admin on one tier and web server on another. PS : Another instance (development) exists on the same server with the same configuration, which was working fine. Issue : When trying to access the login page of Oracle Apps, received the below error. Even OAM login page was throwing the same error. Request URI: /OA_HTML/AppsLocalLogin.jsp Exception: java.lang.ExceptionInIniti
Read more

Solution to "End Program - WMS Idle"

-
Image
Though this topic is unrelated any Apps DBA topics, I found it necessary to share the solution so that everyone benifits out of it ! Issue: I used to receive the below error message whenever I tried to shutdown windows XP. A rather vexing problem, no doubt. Cause: This message appears because when windows is trying to shutdown and end all the running processes, the WMS idle process keeps working. Thus an end-program message appears. The two most common reasons for this are: Scout service run by Nero 7 Microsoft Office Communicator 2005 Solution: The fix is simple, disable the Nero 7 scout service if it is enabled. For this, go to Start > All Programs > Nero > Tools > Nero Scout . On this screen , Uncheck Enable the Nero scout. This will fix the issue for most of the users, for the rest of you who are not using Nero are most probably getting this error because of Microsoft Office Communicator 2005. For that you need to either manually exit the communicator 2005 from the s
Read more

WGET shell Script for downloading patches

-
What I have to offer this time is a script using which you can download patches using WGET from Meta.....oops, from My Oracle Support, I should say! This script needs (or accepts) the following parameters: 1. Me...oops...MOS Username 2. MOS (I got it right this time!) password 3. Patch file name 4. ARU Number You can get 3 and 4 in the following way: Using MOS: Query for the particular patch, click on the download link, click on WGET Options on the left side bottom corner and then copy the WGET script to clipboard. That script will have both the patch name and the ARU number. Using HTML (supporthtml.oracle.com): Query for the particular patch, click on the patch, then RIGHT CLICK on the patch zip file link and click on copy shortcut in IE (or copy link location in Mozilla Firefox). This link will have both the patch file name and the ARU number. Using the classic patches window: Query for the particular patch, then RIGHT CLICK on the DOWNLOAD button and click on copy shortcut in IE (or
Read more