itmanager.blogs.comAlex Scoble's IT Notes - An Information Technology Blog

My experiences as an IT professional - Anything that I write here is my personal opinion and should not be officially associated with any other entity Home Archives Profile Subscribe Monday, August 20, 2018 Using filebeat hint based autodiscover with kubernetes In case you ever try to use kubernetes hint based autodiscover in filebeat, I have a couple of sample gists that should help you get there beyond the Elastic co docs, which leave some key things out. https://gist.github.com/ITBlogger/f50632d643ec4cb241bdd41355b295ba Most notably, you no longer specify plugin or module configs and you have to put the annotations under 'spec.template.metadata.annotations' Hopefully, this helps anyone out who searches for filebeat kubernetes autodiscover hints Posted at 05:18 PM in DevOps | Permalink | Comments (0) Tags: devops, filebeat, kubernetes Reblog (0) Saturday, June 02, 2018 Working with Ansible and AWS EC2, SG, ASG and ELB tags I haven't blogged in a very long time, but felt this was something that should be shared. Sometimes tools deal with the same type of information inconsistently and that can cause you serious headaches and a lot of effort to resolve. In this particular case, Ansible requires AWS tags to be in list format for autoscaling groups (ASGs) and to be in dict format for elastic load balancers (ELBs) and security groups (SGs). If you try to use a list of tags for ELBs or SGs, you'll get the following error: "argument tags is of type <type 'list'> and we were unable to convert to dict: <type 'list'> cannot be converted to a dict" Of course, you'll get a similar but opposite error if you try to use tags in dict form for ASGs. "argument tags is of type <type 'dict'> and we were unable to convert to list: <type 'dict'> cannot be converted to a list" If you're like me, you want to define your config data once and manipulate it as needed. In our case we have a few hashes/lists of hashes of AWS tags that need to be combined to be useful with the various Ansible ec2 modules. You can see here https://gist.github.com/ITBlogger/a5b1ac1ab7ac2f12c4d7f6f77be359e7 that I've setup a gist of what I'm talking about You can go here https://gist.github.com/ITBlogger/a5b1ac1ab7ac2f12c4d7f6f77be359e7#file-aws_role_sample-L27 and see from line 27 to line 71 how we're manipulating the lists to combine them for one use and recreate them into dicts for the other usages. - name: change native_tags list to dict set_fact: merged_tags: '{{ merged_tags | combine( item ) }}' with_items: '{{ native_tags }}' The above shows how we're using the jinja2 combine filter and with_items loop to go over the list of tags and add them to the merged_tags dict which is used later. https://gist.github.com/ITBlogger/a5b1ac1ab7ac2f12c4d7f6f77be359e7#file-aws_role_sample-L41 You can also see in the playbook vars that we've initialized merged_tags as an empty dict `merged_tags: {}` https://gist.github.com/ITBlogger/a5b1ac1ab7ac2f12c4d7f6f77be359e7#file-aws_playbook_sample-L16 Hope this makes sense given the gist examples To create the list of tags from the multiple sources, we use the + operand: `merged_asg_tags: '{{ native_tags }} + {{ asg_native_tags }} + {{ asg_extra_tags }}'` https://gist.github.com/ITBlogger/a5b1ac1ab7ac2f12c4d7f6f77be359e7#file-aws_role_sample-L65 Also hope you understand that we're talking about AWS tags here and not Ansible tags, although the gist example does use Ansible tags as well. Posted at 08:00 PM in DevOps | Permalink | Comments (0) Tags: ansible, aws, combine, devops, dict, filter, jinja2, list, tags Reblog (0) Thursday, April 16, 2015 Using Ansible to manage sudoers in Linux This is an excellent blog post on how to use Ansible to config the /etc/sudoers file on Linux systems. https://raymii.org/s/tutorials/Ansible_-_Sudo_Safety_and_Sanity_Checks.html Posted at 02:15 PM | Permalink | Comments (0) | TrackBack (0) Reblog (0) No separate /var volume when booting Red Hat from iscsi Hope you never have to run in to this problem, but if you ever have to install Red Hat using an iSCSI boot disk do not set up /var as a separate partition. Doing so will seriously break the server because iSCSI state data is held in /var/lib/iscsi and Red Hat cannot access this data if /var is a separate lvm volume as it needs that data in order to mount /var. This applies to all versions of Red Hat. Posted at 11:34 AM | Permalink | Comments (0) | TrackBack (0) Reblog (0) Sunday, March 22, 2015 Chocolatey means never having to use Internet Explorer or any Microsoft browser ever again @powershell -NoProfile -ExecutionPolicy unrestricted -Command "iex ((new-object net.webclient).DownloadString('https://chocolatey.org/install.ps1'))" && SET PATH=%PATH%;%ALLUSERSPROFILE%\chocolatey\bin That command means never again having to use IE or any other Microsoft browser. Follow by: choco install googlechrome Posted at 11:13 PM | Permalink | Comments (0) | TrackBack (0) Reblog (0) Monday, November 10, 2014 Ruby 1.8.7 Parsing CSV Files Without FasterCSV Working With CSV Files In Ruby 1.8.7 Without FasterCSV The following Ruby code sample shows how to bring in data from a csv file with headers in a way that allows you to manipulate the date by header name. inputfile = ARGV[0] csv = CSV.open(inputfile, 'r') Column = Struct.new(*(csv.shift.map { |f| f.to_sym })) columns = csv.inject([]) do |columns, row| columns << Column[*row] end csv.close columns.each do |c| column1 = c.column1header column2 = c.column2header column3 = c.column3header column4 = c.column4header <put your code that uses the column names to do whatever it is you need to do here> end Found this solution in the book " Enterprise Integration with Ruby by Maik Schmidt " Posted at 04:52 PM | Permalink | Comments (0) | TrackBack (0) Tags: csv, ruby, scripting Reblog (0) Wednesday, July 02, 2014 Any bets on when CentOS 7 will be released? Posted at 10:50 AM | Permalink | Comments (0) | TrackBack (0) Reblog (0) Saturday, June 21, 2014 Windows support is coming to Ansible soon. That's cool. Puppet needs the competition to keep them refining Puppet Enterprise. Posted at 01:25 PM | Permalink | Comments (0) | TrackBack (0) Reblog (0) Thursday, May 22, 2014 Here's hoping that all this experience that I'm gaining with the Ceph distributed storage solution on Linux won't go to waste. CRUSH FTW! Posted at 04:00 PM | Permalink | Comments (0) | TrackBack (0) Reblog (0) Friday, May 03, 2013 Networking for OpenStack When using Mirantis Fuel Web to build up an OpenStack cloud, it requires 6 separate networks to be created. Simplest way to do this is by using virtual networks (VLANs), however this presents a few challenges because of the complexities of configuring VLANs. This post is specific to Cisco switches, but may be relevant for other networking equipment as well. For test purposes, this was all done on one switch and each bare metal server had one interface cabled to the switch. In production environments, it is likely that, at a minimum, a completely separate storage network would also exist, but more complicated networking schemes are quite possible. For each port on the switch that will be connected to one of the bare metal servers, the following needs to be done: switchport mode trunk switchport trunk allowed vlan 10,100-104 switchport trunk native vlan 10 spanning-tree portfast trunk switchport nonegotiate Trunking mode must be used because each interface needs to be able to handle all 6 of the virtual networks. In the normal access mode, an interface can only communicate over a single VLAN. For each interface, it's a good practice to specify which vlans it is allowed to handle. Trunk native tells the switch that untagged traffic goes over this vlan. VLAN tags are the mechanism that allows a network interface to communicate over multiple discrete subnets. So in this case, only traffic going over vlans 100 through 104 will be tagged. Spanning-tree portfast trunk tells the switch that this port is...