masteragent install server site

Diaz

Good day, we've deployed the masteragent on the server side, however, when we reboot Logstash, we encounter an error as if the logserver plugin is missing. Upon entering the command /usr/share/logstash/bin/logstash-plugin list, we can't find such a plugin to install. What's the correct way to resolve this error?

Logs:

2023-11-20T15:27:15,551][ERROR][logstash.plugins.registry] Tried to load a plugin's code, but failed. {:exception=>#<LoadError: no such file to load -- logstash/outputs/logserver>, :path=>"logstash/outputs/logserver", :type=>"output", :name=>"logserver"}
[2023-11-20T15:27:15,557][ERROR][logstash.agent           ] Failed to execute action {:action=>LogStash::PipelineAction::Create/pipeline_id:masteragent, :exception=>"Java::JavaLang::IllegalStateException", :message=>"Unable to configure plugins: (PluginLoadingError) Couldn't find any output plugin named 'logserver'. Are you sure this is correct? Trying to load the logserver output plugin resulted in this error: no such file to load -- logstash/outputs/logserver", :backtrace=>["org.logstash.config.ir.CompiledPipeline.<init>(CompiledPipeline.java:119)", "org.logstash.execution.JavaBasePipelineExt.initialize(JavaBasePipelineExt.java:83)", "org.logstash.execution.JavaBasePipelineExt$INVOKER$i$1$0$initialize.call(JavaBasePipelineExt$INVOKER$i$1$0$initialize.gen)", "org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:837)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuper(IRRuntimeHelpers.java:1169)", "org.jruby.ir.runtime.IRRuntimeHelpers.instanceSuperSplatArgs(IRRuntimeHelpers.java:1156)", "org.jruby.ir.targets.InstanceSuperInvokeSite.invoke(InstanceSuperInvokeSite.java:39)", "usr.share.logstash.logstash_minus_core.lib.logstash.java_pipeline.RUBY$method$initialize$0(/usr/share/logstash/logstash-core/lib/logstash/java_pipeline.rb:47)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:80)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:70)", "org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:332)", "org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:86)", "org.jruby.RubyClass.newInstance(RubyClass.java:939)", "org.jruby.RubyClass$INVOKER$i$newInstance.call(RubyClass$INVOKER$i$newInstance.gen)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:207)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline_action.create.RUBY$method$execute$0(/usr/share/logstash/logstash-core/lib/logstash/pipeline_action/create.rb:52)", "usr.share.logstash.logstash_minus_core.lib.logstash.pipeline_action.create.RUBY$method$execute$0$__VARARGS__(/usr/share/logstash/logstash-core/lib/logstash/pipeline_action/create.rb)", "org.jruby.internal.runtime.methods.CompiledIRMethod.call(CompiledIRMethod.java:80)", "org.jruby.internal.runtime.methods.MixedModeIRMethod.call(MixedModeIRMethod.java:70)", "org.jruby.ir.targets.InvokeSite.invoke(InvokeSite.java:207)", "usr.share.logstash.logstash_minus_core.lib.logstash.agent.RUBY$block$converge_state$2(/usr/share/logstash/logstash-core/lib/logstash/agent.rb:389)", "org.jruby.runtime.CompiledIRBlockBody.callDirect(CompiledIRBlockBody.java:138)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:58)", "org.jruby.runtime.IRBlockBody.call(IRBlockBody.java:52)", "org.jruby.runtime.Block.call(Block.java:139)", "org.jruby.RubyProc.call(RubyProc.java:318)", "org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:105)", "java.base/java.lang.Thread.run(Thread.java:829)"]}

SzymonC

logserver output plugin in Logstash is added as out-of-the-box in newer versions of the system.
You can however add it manually. Download it from our repo, using your user and password from license file .info extension.
https://repository.energylogserver.com/logstash-all-logserver-1.0.0.gem.zip

On the logstash, you can manually install it with this command:
/usr/share/logstash/bin/logstash-plugin install file:///etc/logstash/plugins/logstash-all-logserver-1.0.0.gem.zip
Of course, where file statement begins, you need to point valid path to the plugin file. 🙂

Diaz

Hello,

I'm facing issues with resolving the manticore dependencies in Logstash. Different Logstash components require various versions of this library, resulting in conflicting dependencies:

logstash-core requires manticore (~> 0.6) java.
logstash-filter-logserver requires manticore (>= 0.7.1) java.
logstash-filter-http requires manticore (>= 0.5.2, < 1.0.0) java.
logstash-output-elasticsearch requires manticore (>= 0.5.4, < 1.0.0) java.
These requirements create a conflict in manticore versions, leading to unresolved dependency conflicts. Could you please advise on how to resolve this issue or provide recommendations for compatible manticore versions that satisfy the requirements of all Logstash components?

Thank you in advance for your assistance.

SzymonC

I see that version of logstash is 7.12.1, which most likely is the issue here. What is your general system version? You can check it in UI in the top right corner:

That info is needed, because from here we have a two main options. Either we update Logstash or it might be easier to just change the output plugin.

Diaz

Good day! Our ELS has been updated to 7.4.0

Also, I wanted to clarify if, to update to 7.4.1, we need to download the 7.4.1 installer or if we can manage with the command ./install -u.

SzymonC

If your server is connected to the Internet, I'd recommend:

Backup content of whole /etc/logstash/ directory.
Do rpm -qa |grep logstash, and remove it: rpm -e logstash-oss-...
Install logstash from ELS install package: rpm -i install/logstash/logstash-oss-7.17.11-x86_64.rpm
After installation do /usr/share/logstash/bin/logstash-plugin update
Replace new /etc/logstash with old from step 1.

If it's not connected to the Internet and you have production environment going on and you don't want to risk anything - call your local partner/Energy Logserver distributor and go with the official support path.