• 5 Posts
  • 979 Comments
Joined 1 year ago
cake
Cake day: August 11th, 2023

help-circle



  • What is a good alt for cloudflare here tbh?

    I’ve done wire guard, and tor service to obfuscate the network, and crowdsec for a good external firewall, and linkerd gateway to actual services (and keycloak for sso).

    Besides adding gotelaport for more fine grained access, idk what else you could do, but even then idk if its still competitive as someone else’s network taking your ddos loads lol








  • Honestly I thinkyour self driving example is something this could be really cool for. If the generation can exceed real time (I.e. 20 secs of future image prediction can happen in under 20 secs) then you can preemptively react with the self driving model and cache the results.

    If the compute costs can be managed maybe even run multiple models against each other to develop an array likely branch predictions (you know what I turned left)

    Its even cooler that player input helps predict the next image.








  • Very much pro Open Source AI. Especially as a concept digital public good. With https://petals.dev/ being the most promising option that regard (imagine something like RAG for the arch wiki with very large models supported by the community!).

    It feel very enthusiasts right now. Where I feel like I’m just on the cusp of having usable set up.

    I personally really want a full Dev that just takes gitlab issues and runs codes against tests until it passes, and then cycles between attempting to explain what it doing and refactoring until that explanation is reasonably simple, then submit PR.

    At the moment I am trying to use it as a copilot (ollama lama3, continue, and devonAI vscode plugins) all on my MacBook (my Linux machine were too small gpu wise, at least first time I attempted). That said it ok for questions no real luck on a decent experience for actually making anything.

    The next step to me for it to move from enthusiast to hobbiest would be:

    1. Models that just work on my machine. I had to do a lot of trial and error just get performant models.
    2. Models just my use case. I don’t know what model support tooling, or multimodal inputs. What models are actually optimized for programing, for actions (ala openinterpretor), for reviewing documents, etc.
    3. For federated (like pedals.dev) I feel like I need some sane data guardrails. I don’t want my medical documents anywhere near “bittorrent style” anything, but would absolutely love to leverage it for better outcome on opensource projects without secrets file. This also feeds into point 2 to me.
    4. More sane RAG. Maybe even IPFS links to caches or DBs for popular data sources (like code docs for example).

    I feel like there has to be a better way for this. Maybe its just selinux rules for data tags for locking down my local system and some routing config file at the root of my projects. Idk tbh


  • Win 7 was cool to tinker with but buggy as hell to the point Ubuntu was just as much work as the time but with even more possibility.

    8 was so bad it was worth skipping.

    10 was the peak of it just works for windows. Gone were the days of troubleshooting triple AAA games on my PC, they worked or needed patched by the devs.

    That said if I NEEDED something to work choosing windows 10 or server was an exercise is maschocism. Need this container? Unsupported. Need this service configured like this? Gfl finding where that is set. Need HA? Just Ha. Certain network configs beyond basic client? The guys with decades of Windows admin exp still have no idea.

    I had to troubleshoot both but windows gives you the nice feeling of being able to say “this sucks they should fix that” because I know ain’t. Its not built for me to fix it either. Linux however begs you too. Its all there, you can do anything, even you might not really want to.