Monday, January 4, 2021

Moving to Wordpress

Dear Readers,

I have made a tough decision to move my blog from blogger to WordPress. In the recent events of censorship on platforms such as Twitter, YouTube, and Facebook, I was fearful of being censored on my own blog and website if I continued to use a platform managed by Google.  Google is one of the offending companies in the onslaught of web censorship and for the safety of my content I have made the decision to make a move.  In the coming weeks you will see new content posted on my new WordPress site at https://techshepherd.tk  

I have also migrated a majority of the content from my personal research site to the new free servers.  I am sorry for the change as I know I have at least a few followers on here.  I may post links to articles here for a little while longer, but the plan is to retire the blog as soon as feasible.

Thanks for reading.

Scott

 

Wednesday, May 6, 2020

Digital Censorship

I saw something today that I thought I would never see in my lifetime. A doctor in Madagascar developed a homeopathic remedy for COVID-19 which apparently is being used by the nation and has allowed them to reopen and go back to life as normal. However, if you try to search for pricing or availability of this drink Covid-organics on Google in the shopping category you get blocked.

It even blocked my ability to screen shot the block, thus the reason for the low quality photo.  I wanted to make my readers aware of what is starting to happen in regards to free speech in our country and the world.

Blocked Facebook post.

This is not the only thing being censored. The website www.plandemicmovie.com is asking for help getting their video documentary on the major platforms. It gers blocked within minutes of being posted because it is speaking what I believe to be the truth about COVID-19 and vaccines in general.  I will be posting their video here later tonight as well as sharing across my social media platforms and ask my readers to do the same. Even if you don't agree with the views in the video as this is more about protecting free speech and freedom of the press than a shared opnion on medical care.
In fact, if you have a link to videos that are being blocked on the other side of the issue leave a comment here and I will be glad to attempt to get the word out about them as well, even though I may not agree with the content.
We need to flood the gatekeepers.of internet censorship and speak out for pur freedom.

Just found out that a joke I posted yesterday was censored by Facebook as well so much for free speech.


Thursday, April 23, 2020

Which is more important to you, health or privacy?

In the light of the “new normal” brought about with the COVID-19 virus, there are some technically possible, but ethically questionable ideas on how to track and prevent the virus. I am talking about the utilization of the blue tooth chip in your cell phone to track other people, or rather other cell phones that you have come within a given radius.  

The technology has existed for a long time and many of us use it daily. Bluetooth is a short-distance, high-frequency radio transmitter and receiver pair in a majority of cell phones, radios, computer, televisions and vehicles manufactured in the last 10 years. The technology was introduced by Ericsson in 2001 in their T36 phone. The technology allows devices to communicate with each other across distances of 33-feet or less. The crazy part is that the latency of the Bluetooth signal, which is the time it takes the signal to make a round trip between two devices, can very accurately determine the distance between the devices.

Both Apple and Google are working together to engineer a supposedly anonymous method of using this signal to determine when two devices come in close proximity to each other. Currently they are engineering around a distance of six feet to match the World Health Organization’s social distancing recommendations. The plan is to send tracking information back to Google and Apple in a centralized, cloud-based database. Google is likely to host the data for both parties. A COVID-19 patient would use their device to scan a QR-code supplied by their doctor. This device then becomes a trigger mechanism and notifies every device that has been within six feet of it that the owner may have come in contact with the virus and should be tested.

I believe it is a technologically feasible use case for Bluetooth and a great way to notify people of supposed contact with the virus, but what about the privacy aspects? There are claims that they will use randomized Bluetooth IDs that change hourly on every device participating the program. These random IDs will be stored in a central database, but never cross-referenced to the previous ID. Each device will keep a list of every ID it has broadcast for a period of 14-days based on the incubation period of the disease. If a device owner is infected, the list of all its IDs are cross-referenced in the database to notify devices holding the IDs that were contacted. The big problem is the extremely large size of the data transfer required to keep the privacy.  

Another major problem is, as I have mentioned in previous articles on internet safety, once something is on the internet, it is there forever. This includes the private random IDs and every other random ID they have contacted. If you believe for a minute that data processing giant Google does not have a market plan for this data, you are fooled. They claim they will keep the information completely private and only authorized health care organizations would be able to access the tracking data. I take issue with them gathering the data in the first place. Even knowing how many devices I come in contact within a given two-week period is a big enough invasion of privacy to give me concern.

I also worry that if Google and Apple are able to create this level of tracking, they are not the only ones capable of creating such a system. Your private life is no longer private if you carry a cell phone. They will be able to track where you are, when you got there and who is there with you. So my question to you is, how much privacy are you willing to give up for protection from an illness. I know the question is going to be asked of us all soon. You can read full details about the plans and technology on The Verge https://www.theverge.com/2020/4/10/21216484/google-apple-coronavirus-contract-tracing-bluetooth-location-tracking-data-app.

Tuesday, April 21, 2020

Drones using sonar for sight

One of the most interesting innovations in robotics in the last year was the development of a sonar system for robots that utilized a simple system of a single speaker and two microphones to mimic the sonar of bats. These “Robats” were developed at Tel Aviv University in Israel early last year.

You might ask what the advantage is of using sonar for robotics when we already have excellent computer vision techniques and LiDaR. There are two main factors to take into consideration. The first is that LiDaR units are both heavy and expensive, though we can achieve a more detailed model of the environment with LiDaR at around a resolution of one centimeter. Measurements are accurate to one centimeter versus the five-centimeter resolution of sonar. These are both problems for developing flight worthy drones.

A typical LiDaR unit bounces a laser beam off of materials in the environment several times a seconds resulting in a lot of data to process in order to map the environment. The sonar unit developed in Tel Aviv sends three pulses every 30 seconds and processes the data to result in an accurate map for navigation with much less data.  

A typical LiDaR unit costs around $150 dollars for a low-end unit that has a resolution similar to the Sonar used in the Robat. The students at Tel Aviv replaced this unit with $15 in parts, showing an overall cost reduction of 90 percent. They also reduced the weight of the mapping unit substantially, from around five pounds to around five ounces.  

Just last month they modified the system from using a single speaker and two microphones to using two speakers and four microphones to allow for 3-D mapping from a flying drone, versus the walking Robat introduced in January 2019.  

I took great interest in this project as I have a lot of junk electronic components lying around and wondered if it would be possible to reproduce their results with simple electronics found around the house. I discovered that not only is it possible, but it is basically how they started the project.  

If you would like to learn how to do something like this, you can follow a project on instructibles.com to build a spinning SODAR (blend between Sonar and LiDaR) to keep from being confused with a real Radar or Sonar system. I plan on building one as soon as I can gather all the components. You can find the project at https://www.instructables.com/id/DIY-360-Degree-SODAR-Device/.

I foresee a lot of people tinkering around with robotics as we are ordered to stay at home. I recommend picking up an ardunio kit that comes with a fairly large number of electronic components and taking some time to learn how to build your own robot. Who knows? You might make the next big robotics discovery in your own home. 

Friday, April 10, 2020

Supercomputing and COVID-19

You might think that computers and the COVID-19 virus have very little to do with one another. However, there are several things that have happened in the computing industry as a result of COVID-19. The first was the massive increase in working from home, which caused an unexpected spike in the amount of video streaming traffic on the internet. The second was in the supercomputing industry.

The largest supercomputers in the world, usually used by government agencies for defense and energy research, have been repurposed for medical research. The Summit Supercomputer at Oak Ridge National Lab had a primary purpose of designing next generation batteries, nuclear power reactors and nuclear weapons systems; it has been completed retooled in the last weeks to search for drug treatments.

How exactly does a supercomputer search for drugs that can help fight viral infections? It is a very interesting science. Every virus has a unique chemical shape, as does every drug. Through a history of clinical trials and laboratory testing, scientists now know how to determine if drugs will help to treat viruses by looking at how the “shapes” of the chemical in the drug and virus fit together. It’s like trying to put together a trillion-piece puzzle. 

As it turns out, drugs that fit tight to the surface of the virus close the virus off from the body and cause it to die from lack of interaction. They also block the virus from causing symptoms in the carrier. Since we have a very large database of the chemical compounds in every manufactured drug and have the chemical profile of the virus, it is just a matter of finding the compounds that will be effective in sealing off the virus.

To find these compounds requires a very deep search through millions of drugs that can be combined in more than several trillion possible combinations to react with the virus in different ways. These computational reactions require an extreme amount of computing power, and most molecular biologists do not have access to the necessary computing power to simulate models of this size. They normally run these models over the course of several months to come up with a weighted list of possible treatments. They then have to manually test these compounds in a lab before coming to a useful conclusion. The process of drug matching and design for each new disease is normally a year or more.

Summit is not the only supercomputer being used to research drug treatments for COVID-19. In fact, if the virus is under control before November, I expect there will be a large number of research papers presented at the conference based around COVID-19 research. The US has opened 30 supercomputers, or at least portions of them, to global researchers for use in finding a treatment for COVID-19. Europe, Russia, China and Japan are all doing the same.

If you want to know more about supercomputing and drug research, just hit Google and you will find countless articles on supercomputers by IBM, HPE, Hitachi, Dell, Atos and Penguin Computing, to name a few, being utilized for drug research. If only the power of quantum computing were ready for real computational chemistry and biology research, we might have a cure already.

Stay safe and use the time away from friends and work to learn something new. I highly recommend picking up a programming language. Python is fairly easy to learn and there are a lot of free tutorials for all ages. 

Saturday, April 4, 2020

Livestreaming for churches


By Scott Hamilton


Last week I wrote about the impact of COVID-19 on Internet service providers. I had promised an article this week regarding the impact on local churches and their need for live streaming their services. Many of your churches may already be using Facebook live to keep in touch. That seems to be the easiest way for people to gain access to video content. It is also quite simple for the churches to use. However, if you want a more professional look for your online service, I have some recommended tools. 

The first software I would recommend is called Open Broadcast Software, or OBS, for short. This is a piece of software that allows you to connect to any IP-based web camera including the one integrated into most cell phones. This will allow you to use multiple camera angles as well as stream content direct from your computer to give your service a more personal feel. The best part about OBS is it is open source software, meaning that it is free. You can safely download it for yourself for MacOS, Windows or Linux at https://obsproject.com.

I downloaded OBS last week and began to play online myself. I discovered it is as simple to use as PowerPoint. You simply set up your cameras, screen capture and audio devices, then drag and drop  any of the devices from the list to a display window. You can display one at a time or overlay them with each other. It is a drag and drop, “what you see is what you get” interface for video broadcast. You can stream videos to Facebook Live, YouTube, Twitter or any number of free, online streaming services. 

The second thing I would recommend is a high-quality HDMI capture card. This will allow you to use a secondary computer to display lyrics during worship, Bible verses during teaching, or any other text or image content, just like you use on your current projector in the sanctuary. This greatly simplifies the process of overlaying visual content with live video streams of the speaker or the worship team. 

The third recommendation is the proper cable for connecting your soundboard directly to the computer. This will create higher quality sound than relying on the microphone on your cell phone, camera or computer. It is probably best to feed the sound signal from a separate channel on your existing soundboard; this way you can adjust the audio levels for high quality broadcast. Otherwise you may pick up background noise, echoes and other acoustical problems arising from the shape, size and acoustical properties of your sanctuary. 

Lastly, I would recommend one of the top sites for both supporting and streaming Christian content for churches. Life Church, at http://www.lifechurch.tv, offers free websites and streaming services for churches regardless of denomination; they also offer technical support via e-mail or chat to help you get things going. Head on over and check them out.

I would like to thank all the area churches for the efforts they have put forward to continue the positive message of Christ during the crisis of COVID-19. I especially applaud the churches in the area with very little technical expertise. They have made the effort to learn technology in order to continue reaching their community. In conclusion, I am willing to help if you are stuck with a technological question. Feel free to email me at 3kforme@gmail.com. Enjoy your week and stay safe.

Friday, March 27, 2020

Covid-19 impact on the internet

By Scott Hamilton

I would like to open by stating that this week’s article is a lot more opinion and observation than pure facts about the impacts of Covid-19 on the internet. There have been clear impacts to network infrastructure as a result of the social distancing and working from home orders across the country, but there are just not enough facts listed to put a real number on the impact.

Over the past week there have been numerous articles published around the world questioning if the current internet infrastructure could handle the extra traffic from everyone being forced to work from home. The Wall Street Journal predicted that the infrastructure was not ready for such extra workload and we would be looking forward to websites failing to load and online meeting platforms overloading. The New York Times reported exactly the opposite, that we would see minimal impact from the extra loads. As a work from home, high performance computing engineer and cloud architect, I had some questions myself over whether or not the infrastructure could handle the extra load. The European Union requested that Netflix stop streaming high definition videos to reduce the network load across Europe during the outbreak as a precaution to prevent failures.

We are over week into a new society, at least for a short period of time, where a majority of us are working from home. The impact has been minor from my experience, as a user of rural internet service split between a mix of cellular network tethering, satellite service, and microwave-based internet. I have found performance increasing since the onset. I must admit it came as a surprise to me to see performance increase. Here’s the deal: my providers all lifted the imposed bandwidth limits during the outbreak. 

I wonder if they will reimpose the limits following the outbreak. If so, it will lead to a lot of questions from customers. If you ask the reason for the limits, they will say it is because their network cannot handle the full load of all the users. The fact that the limits have been lifted prove that their networks will handle the load of all the users. Now is the perfect time to stream all your favorite television shows, download all your favorite books and use the internet to your fullest ability, because the limits will come back. 

The real impact this virus has had on technology is that the imbalance of network connectivity among students has came into full light. There are students all over Texas and surrounding counties that do not have the necessary bandwidth to stream online classes during the school-from-home period. This prompted many providers, not only in our area, to lift limits to educational sites and cloud based services.

Among the companies to lift the bandwidth restrictions are AT&T, Verizon, T-Mobile, Sprint, Hughesnet, U.S. Cellular and Comcast to name few. Many others are offering steep discounts on new service installations, taking advantage of our need for speed. I would say that now is a great time to look into getting high speed internet service if you do not already have it, mainly because these deals will likely never come around again.

There are also several 30-day free trials for streaming and education services to keep us entertained and educated during the social distancing period. I challenge you to take a look around for special offers and enjoy trying some new things online. Hey, if you can’t explore the community, you may as well get out there and explore the virtual world.

Next week I plan on doing an article on live-streaming and give details as to how many of our local churches are beginning to offer online worship services and Bible teaching. I will provide pointers to those that are looking for ways to continue their services online. I have also seen local dance studios, fitness trainers and others offer online classes in lieu of face-to-face training. Take a moment to enjoy the flexibility technology has brought during this time of crisis, and who knows, maybe you will find something new to enjoy even after this is all over. 

Wednesday, March 18, 2020

Cloud and HPC workloads part 3

   The final reason HPc workloads are slow tui migrate to the could had to do with storage. HPC generates and processes very large quantities of data.  Most have directed capacities well above 1 petabyte.  
  There are three main factors impacting HPC and cloud storage. First is that HPC applications expect a POSIX file system which is usually implemented on block devices where file system objects point to links blocks of information that can be accessed both sequentially,  or randomly.  Many times these applications utilize the fine storage like shared memory locations and modify individual blocks within the file. RFID requires low latency onthe file system as well as organized storage patterns.   Cloud storage utilizes block storage deep under the hood but limits access to the c blocks and instead serves files add objects in there storage platform.  In effect simplifying there structure and returning them as a single stream of data. You cannot easily modify the content of an object so utilizing them as memory addresses due not really work out. 
  The second shortcoming is a limitation of Acess Control in object storage which makes it difficult to secure these large databases at a granular level on the cloud. Controlling access for individual users at the object level becomes extremely challenging in object syste scenarios.  
  The final limitation is the unpredictable performance if object based storage.  The location of the object impacts the speed of retrieval as well as the refresh rate of the object.m, making it impossible to treat the object as a shared memory space for HPC applications because there is no guarentee that the object updates get stored before the file is accessesms by neighboring processes causing some major issues in code performance. 
    There are global experts working on solutions to these and other problems relating to HPc workloads in the cloud,  but I feel we're still a few years away from seeing mainstream HPC use of cloud architectures. 

Tuesday, March 17, 2020

Happy late pi day!

In honor of the never-ending number pi, we have one of a few international holiday celebrations. Pi Day was first celebrated on March 14, 1988, which also happens to coincide with Einstein’s birthday, March 14, 1879. Pi Day was first celebrated as a part of an Exploratorium staff retreat in Monterey, Calif. In March 2009, Pi Day became an official U.S. national holiday.

As part of my recognition of Pi day, I would like to explore the history of the number, who first discovered it, how it was originally estimated, and simple ways you can estimate it yourself. For starters, Pi is the ratio of a circle’s circumference to its diameter, or the length all the way around a circle divided by the distance directly across the circle. No matter how large or small a circle is, its circumference is always Pi times its diameter. Pi = 3.14159265358979323846… (the digits go on forever, never repeating, and so far no one has found a repeating pattern in over 4,000 years of trying.)

One of the most ancient manuscripts from Egypt, an ancient collection of math puzzles, shows Pi to be 3.1. About a thousand years later, the book of 1 Kings in the Bible implies that pi equals 3 (1 Kings 7:23), and around 250 B.C. the greatest ancient mathematician, Archimedes, estimated pi to around 3.141. How did Archimedes attempt to calculated pi? It was really by doing a series of extremely accurate geometric drawings, sandwiching a circle between two straight-edged regular polygons and measuring the polygons. He simply made more and more sides and measured pi-like ratios until he could not draw any more sides to get closer to an actual circle.

Hundreds of years later, Gottfried Leibniz proved through his new processes of Integration that pi/4 was exactly equal to 1 – 1/3 + 1/5 – 1/7 + 1/9 - . . . going on forever, each calculation getting closer to the value of pi. The big problem with this method is that to get just 10 correct digits of pi, you have to follow the sequence for about 5 billion fractions.

It was not until the early 1900s that Srinivasa Ramanujan discovered a very complex formula for calculating pi, but his method adds eight correct digits for each term in his sum. Starting in 1949, calculating pi became a problem for computers and the only computer in the U.S., ENIAC, was used to calculate pi to over 2,000 digits, nearly doubling the pre-computer records.

In the 1990s the first Beowulf style “homebrew” supercomputers came on the scene. The technology was originally developed to calculate pi and other irrational numbers to as much accuracy as possible. Some of these systems ran over several years to reach 4-billion digits. Using the same techniques over the years, we currently are at 22-trillion digits. This is a little overkill considering that, using only 15 digits of pi, you can calculate the circumference of the Milky Way galaxy to within an error of less than the size of a proton. So why do it? President John F. Kennedy said we do things like this, “not because they are easy, but because they are hard; because that goal will serve to organize and measure the best of our energies and skills.”

Attempting to calculate pi to such high accuracy drove the SuperComputing industry, and as a result, we have the likes of Google’s search engine that indexes trillions of webpages every day, computers that can replace physics research labs by simulating the real world and artificial intelligence systems that can beat the world’s best chess players. Where would we be today without the history of this number?

Now as I promised, there is a way you can estimate pi with very simple math. You play a simple game called “Pi Toss.” You will need a sheet of paper, a pencil and a bunch of toothpicks; the more toothpicks, the closer your estimate will be. Step 1: Turn the paper landscape orientation. Draw two vertical lines on the paper, top to bottom, exactly twice the length of your toothpicks apart. Step 2: Randomly toss toothpicks, one at a time, onto the lined paper. Keep tossing them until you are out of toothpicks. Make sure to count them as you toss them on the paper. Don’t count any that miss or stick off the edge of the paper, those don’t count. Step 3: Count all the toothpicks that touch or cross one of your lines. Step 4: Divide the number of toothpicks you tossed by the number that touched a line and this will be approximately equal to pi. How close did you come? To find out how this works, read more about Pi Toss at https://www.exploratorium.edu/snacks/pi-toss.

Cloud and HPC workloads part 2

    The second reason HPC workloads are slow to migrate too the cloud is related to cloud networks. A majority of cloud service providers designed the network infrastructure for individual compute resources common in IT services data centers. /for example your corporate file servers do not need a high speed network between them as long as they each have good connectivity to the client systems. It is the same for web servers, database servers, and most other it workloads.
    HPC systems rely heavily on high speed, low latency network connections between te individual servers for optimal performance. This is because of how they share memory resources across processors in other systems. They utilize a library called MPI (message passing interface) to share information between processes. The faster this information can be shared the higher the performance of the overall system.
   HPC systems use networks that are non-blocking, meaning that every system has 100% of the available network bandwidth between every other system in the network. They also use extremely low latency networks reducing the delay from a packet being sent from one system to another to as low as possible.
    In cloud based systems there is usually a high blocking factor between racks and low within a rack, resulting in a very unbalanced network creating increased latency for high perfance workloads, so poor that some HPC application will not execute to completion.  In recent months some cloud providers have made efforts to redesign network infrastructure to support HPC applications, but there is more work to be done.