I have 250 or so soil sensors that I need to QC. They monitor various parameters such as soil temp, soil water content, soil co2, and soil heat flux. It isn't unusual for a sensor to behave poorly due to elk chewing up wires a little bit, electrical noise, and what not.
I already use some basic scripts to filter out based on moving averages, standard deviation, and physical constraints. Sometimes there are sensors that still have bad data, such as this soil water. It looks like there is still a viable signal in that noise that is traced out by a bunch of local minima, and I've confirmed this pattern with nearby sensors.
I've played around with some finite-impulse response filters in MATLAB to try to remove the noise, but I don't really know how to design one of these at all.
Any suggestions, resources, or other filters that could help with QCing this?