As talked about in #15 I tried to refactor the project so that is a little easier to use. I removed the jargs dependency in the maven project because it's not used at all. The pom.xml is more simpler now. I also replaced the add-jars-plugin with a shell script that does what it should. The mentioned plugin manipulated the pom what I consider as evil. Since there are no tests I cannot check if everything works as expected but I trained a model successfully and also tagged the example tweets with the trained model. It all worked.

I've made some steps towards being able to use ark-tweet-nlp easily as a library some time ago.

The first part of this was to provide a proper maven build that produces a self-contained jar (not custom zsh build script or hardcoded paths anymore; all dependencies are cleanly specified and I've made all required external files Resources that get bundled with the jar).

I got diverted onto other things before I could do part two (don't always output stuff to stdout etc.) but you might find the mavenization already useful in itself, so I decided to quickly merge in the last master and send you a pull request before my branch bitrots.

I'm happy to clean up things more if required, but first I wanted to see if there is interest in this patch.

Hey folks,

I just wanted to try out your tagger, but I can't get it to run. First of I tried following your hacking.txt but no success.

Also the project structure is weird for a java project. So I have some questions about this project:

• Why are you providing the jargs jar? Did you change something in it so you cannot use the standard version that is accessible through maven?
• The same goes for the gnu trove jar that you provide. Any changes made to the library?
• Why are you separating the actual src files into the separate src folder in the root of the project while maintaining the resources in the ark-tweet-nlp folder?
• Are metaphone-map2.txt and ptb_ordered_metaphone.txt that are contained in the lib directory external resources or are they created by you? If so, why are they in the lib directory?
• Where is the posBerkeley.jar from? Is it available to the public (e.g. from here)?

Since I want to use/try/evaluate it, I'm very interested in your project. I'm also experienced with maven, java, eclipse so I could help you with restructuring this stuff.

I happened to have an implementation of Gruber's URL regex lying around in a different program, and agreed with the comment in the twokenizer about the Larry David stare. :-) I don't know what sorts of unit tests you guys have for the twokenizer, but this seems to work for me, and this particular regex has worked very well for me in other projects.

How to run algorith with word cluster? "\n --word-clusters Alternate word clusters file (see FeatureExtractor)" + Which filename we have to write here? Thanks in advance

Bumps jackson-databind from 2.0.0 to 2.9.10.7.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Hi Brendan,

We are using your library for a twitter application which we plan to release under GPLv3 however, we cannot release your code with with our GPLv3 as it doesn't specify that your version of software is licensed under GPLv2 and later versions.

So if you can change your license to GPLv2 or later then it will be easier to use your code in GPLv3 released code.

You can see this compatibility matrix to see that GPLv2 or later is compatible with GPLv3 but not GPLv2

I would look forward to your response.

After I use mvn package to build the ark-tweet-nlp-0.3.2.jar, It will report an IOException when I run ./runTagger.sh examples/example_tweets.txt.

Details:

Exception in thread "main" java.io.IOException: Neither file nor resource found for: /cmu/arktweetnlp/model.20120919
    at cmu.arktweetnlp.util.BasicFileIO.openFileOrResource(BasicFileIO.java:250)
    at cmu.arktweetnlp.impl.Model.loadModelFromText(Model.java:409)
    at cmu.arktweetnlp.Tagger.loadModel(Tagger.java:40)
    at cmu.arktweetnlp.RunTagger.runTagger(RunTagger.java:85)
    at cmu.arktweetnlp.RunTagger.main(RunTagger.java:373)

When i try to use the semi-crf tools to train a crf model.I try to use the file in scipts/train.sh. There is an option:--noahsFeaturesFile noah.feats

I've no idea what is the noah.feats looks like. So can you give me an example?

A musician must make music, an artist must paint.., to be ultimately at peace with himself. What a man can be, he must be ~Maslow A small body of determined spirits fired by an unquenchable faith in their mission can alter the course of history.~Gandhi #quote Never for the sake of peace and quiet deny your convictions ~ Dag Hammarskjold #quote 5020

@kz713twt Amanpour 2

Oh my god ! It was an wedding anniversary today, but I stayed at home unfortunately.

For example, from the parent directory of ark-tweet-nlp, I get:

Noahs feature file:null
File with initial transition probs:null
Reading embeddings file...
java.io.FileNotFoundException: lib/embeddings.txt (No such file or directory)
    at java.io.FileInputStream.open(Native Method)
    at java.io.FileInputStream.<init>(FileInputStream.java:137)
    at java.io.FileInputStream.<init>(FileInputStream.java:96)
    at java.io.FileReader.<init>(FileReader.java:58)
    at edu.cmu.cs.lti.ark.ssl.util.BasicFileIO.openFileToRead(BasicFileIO.java:39)
    at edu.cmu.cs.lti.ark.ssl.pos.SemiSupervisedPOSTagger.readDistSim(SemiSupervisedPOSTagger.java:630)
    at edu.cmu.cs.lti.ark.ssl.pos.SemiSupervisedPOSTagger.setVariousOptions(SemiSupervisedPOSTagger.java:531)
    at edu.cmu.cs.lti.ark.ssl.pos.SemiSupervisedPOSTagger.<init>(SemiSupervisedPOSTagger.java:178)
    at edu.cmu.cs.lti.ark.tweetnlp.TweetTaggerInstance.<init>(TweetTaggerInstance.java:62)
    at edu.cmu.cs.lti.ark.tweetnlp.TweetTaggerInstance.getInstance(TweetTaggerInstance.java:24)
    at edu.cmu.cs.lti.ark.tweetnlp.RunPOSTagger.tweetTagging(RunPOSTagger.java:43)
    at edu.cmu.cs.lti.ark.tweetnlp.RunPOSTagger.doPOSTagging(RunPOSTagger.java:39)
    at edu.cmu.cs.lti.ark.tweetnlp.RunPOSTagger.main(RunPOSTagger.java:63)
12-Sep-2011 15:25:03 edu.cmu.cs.lti.ark.ssl.util.BasicFileIO openFileToRead
SEVERE: Could not open file:lib/embeddings.txt

Bumps jackson-databind from 2.0.0 to 2.12.7.1.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Hey there!

I'd like to report a security issue but cannot find contact instructions on your repository.

If not a hassle, might you kindly add a SECURITY.md file with an email, or another contact method? GitHub recommends this best practice to ensure security issues are responsibly disclosed, and it would serve as a simple instruction for security researchers in the future.

Thank you for your consideration, and I look forward to hearing from you!

(cc @huntr-helper)

Bumps junit from 4.8.2 to 4.13.1.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

• Want to take over the Java ecosystem? All you need is a MITM!
• Update: Want to take over the Java ecosystem? All you need is a MITM!

This is a security fix for a vulnerability in your Apache Maven pom.xml file(s).

The build files indicate that this project is resolving dependencies over HTTP instead of HTTPS. This leaves your build vulnerable to allowing a Man in the Middle (MITM) attackers to execute arbitrary code on your or your computer or CI/CD system.

This vulnerability has a CVSS v3.0 Base Score of 8.1/10.

POC code has existed since 2014 to maliciously compromise a JAR file in-flight. MITM attacks against HTTP are increasingly common, for example Comcast is known to have done it to their own users.

This contribution is a part of a submission to the GitHub Security Lab Bug Bounty program.

Detecting this and Future Vulnerabilities

This vulnerability was automatically detected by LGTM.com using this CodeQL Query.

As of September 2019 LGTM.com and Semmle are officially a part of GitHub.

You can automatically detect future vulnerabilities like this by enabling the free (for open-source) LGTM App.

I'm not an employee of GitHub nor of Semmle, I'm simply a user of LGTM.com and an open-source security researcher.

Source

Yes, this contribution was automatically generated, however, the code to generate this PR was lovingly hand crafted to bring this security fix to your repository.

The source code that generated and submitted this PR can be found here: JLLeitschuh/bulk-security-pr-generator

Opting-Out

If you'd like to opt-out of future automated security vulnerability fixes like this, please consider adding a file called .github/GH-ROBOTS.txt to your repository with the line:

User-agent: JLLeitschuh/bulk-security-pr-generator
Disallow: *

This bot will respect the ROBOTS.txt format for future contributions.

Alternatively, if this project is no longer actively maintained, consider archiving the repository.

CLA Requirements

This section is only relevant if your project requires contributors to sign a Contributor License Agreement (CLA) for external contributions.

It is unlikely that I'll be able to directly sign CLAs. However, all contributed commits are already automatically signed-off.

The meaning of a signoff depends on the project, but it typically certifies that committer has the rights to submit this work under the same license and agrees to a Developer Certificate of Origin (see https://developercertificate.org/ for more information).

- Git Commit Signoff documentation

If signing your organization's CLA is a strict-requirement for merging this contribution, please feel free to close this PR.

Tracking

All PR's generated as part of this fix are tracked here: https://github.com/JLLeitschuh/bulk-security-pr-generator/issues/2

Bumps lucene-core from 3.0.3 to 7.1.0.

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Hi,

Has anyone managed removing / replacing the components which make the library GPL, and lived to tell about it?

In particular, for only the POS Tagging, but also, in general?

Thanks!